Aug 05 05:35:56.480269 ip-10-0-134-152 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 05:35:56.886834 ip-10-0-134-152 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 05:35:56.886834 ip-10-0-134-152 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 05:35:56.886834 ip-10-0-134-152 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 05:35:56.886834 ip-10-0-134-152 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 05:35:56.886834 ip-10-0-134-152 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 05:35:56.888722 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.888632    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 05:35:56.893364 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893346    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.893364 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893364    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893370    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893373    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893377    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893380    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893382    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893385    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893388    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893391    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893394    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893396    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893399    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893402    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893404    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893409    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893411    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893414    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893416    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893419    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893421    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.893433 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893424    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893428    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893432    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893435    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893438    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893442    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893445    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893448    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893451    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893454    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893456    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893458    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893461    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893466    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893470    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893472    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893475    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893478    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893481    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.893900 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893483    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893486    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893489    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893492    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893494    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893497    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893499    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893502    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893504    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893507    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893509    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893512    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893515    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893518    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893521    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893523    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893526    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893529    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893531    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.894415 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893534    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893536    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893539    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893542    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893544    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893547    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893549    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893552    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893554    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893557    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893561    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893563    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893566    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893569    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893571    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893574    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893576    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893579    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893582    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893584    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.894875 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893587    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893589    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893592    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893595    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893597    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893600    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893602    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893605    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893607    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893610    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893613    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893615    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893618    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893620    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893623    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893625    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893629    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893632    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893635    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.895372 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.893638    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894413    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894420    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894424    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894427    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894430    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894433    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894436    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894439    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894441    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894444    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894447    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894449    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894452    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894455    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894458    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894461    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894463    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894466    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.895832 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894469    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894471    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894474    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894477    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894480    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894483    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894485    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894488    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894490    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894493    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894496    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894498    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894501    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894503    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894505    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894508    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894510    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894513    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894515    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894518    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.896318 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894521    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894524    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894527    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894531    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894535    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894537    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894540    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894542    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894545    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894548    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894551    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894553    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894556    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894560    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894563    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894566    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894569    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894571    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894574    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.896789 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894577    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894581    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894584    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894586    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894589    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894593    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894596    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894599    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894602    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894605    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894608    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894610    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894613    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894615    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894618    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894621    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894624    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894627    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894630    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.897281 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894633    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894636    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894639    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894642    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894644    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894647    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894649    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894652    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894654    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894657    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894659    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894662    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894664    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894667    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894669    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894672    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894674    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894677    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894679    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894682    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.897736 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894684    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894687    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.894689    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895084    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895089    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895092    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895095    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895098    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895101    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895104    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895107    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895109    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895112    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895117    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895120    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895123    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895126    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895129    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895131    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895134    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.898265 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895137    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895139    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895142    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895145    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895147    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895150    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895152    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895155    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895157    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895160    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895162    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895165    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895168    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895171    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895176    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895179    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895183    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895185    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895188    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.898743 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895191    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895194    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895196    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895199    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895202    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895204    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895207    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895209    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895212    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895215    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895217    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895220    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895222    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895225    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895227    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895230    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895232    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895235    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895237    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895240    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.899212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895243    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895245    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895247    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895250    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895252    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895256    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895258    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895261    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895263    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895266    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895268    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895271    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895273    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895276    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895282    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895284    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895287    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895289    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895292    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895295    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.899725 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895298    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895300    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895303    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895306    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895309    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895311    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895314    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895317    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895319    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895321    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895324    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895327    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895329    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895332    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895334    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895338    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895341    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895344    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895346    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.900212 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895349    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895352    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895355    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.895358    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895428    2581 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895436    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895450    2581 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895458    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895472    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895476    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895480    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895485    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895488    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895491    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895494    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895498    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895501    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895504    2581 flags.go:64] FLAG: --cgroup-root=""
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895507    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895510    2581 flags.go:64] FLAG: --client-ca-file=""
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895513    2581 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895516    2581 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895522    2581 flags.go:64] FLAG: --cluster-domain=""
Aug 05 05:35:56.900666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895525    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895528    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895531    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895534    2581 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895539    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895542    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895545    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895548    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895551    2581 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895554    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895557    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895561    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895564    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895568    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895571    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895573    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895576    2581 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895579    2581 flags.go:64] FLAG: --enable-server="true"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895588    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895595    2581 flags.go:64] FLAG: --event-burst="100"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895599    2581 flags.go:64] FLAG: --event-qps="50"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895604    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895607    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895610    2581 flags.go:64] FLAG: --eviction-hard=""
Aug 05 05:35:56.901301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895614    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895617    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895620    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895624    2581 flags.go:64] FLAG: --eviction-soft=""
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895626    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895667    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895671    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895675    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895678    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895681    2581 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895684    2581 flags.go:64] FLAG: --feature-gates=""
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895688    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895691    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895694    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895697    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895700    2581 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895703    2581 flags.go:64] FLAG: --help="false"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895706    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895709    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895712    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895717    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895721    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895724    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895727    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 05:35:56.901868 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895731    2581 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895734    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895736    2581 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895740    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895743    2581 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895748    2581 flags.go:64] FLAG: --kube-reserved=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895750    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895753    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895756    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895759    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895762    2581 flags.go:64] FLAG: --lock-file=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895765    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895768    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895771    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895776    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895779    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895782    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895785    2581 flags.go:64] FLAG: --logging-format="text"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895788    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895791    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895794    2581 flags.go:64] FLAG: --manifest-url=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895797    2581 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895801    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895804    2581 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895808    2581 flags.go:64] FLAG: --max-pods="110"
Aug 05 05:35:56.902497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895811    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895814    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895817    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895821    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895824    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895827    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895830    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895838    2581 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895841    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895844    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895847    2581 flags.go:64] FLAG: --pod-cidr=""
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895851    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895859    2581 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895861    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895865    2581 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895868    2581 flags.go:64] FLAG: --port="10250"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895871    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895874    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-009c664c5eca02ae3"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895877    2581 flags.go:64] FLAG: --qos-reserved=""
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895880    2581 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895883    2581 flags.go:64] FLAG: --register-node="true"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895886    2581 flags.go:64] FLAG: --register-with-taints=""
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895889    2581 flags.go:64] FLAG: --registry-burst="10"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895892    2581 flags.go:64] FLAG: --registry-qps="5"
Aug 05 05:35:56.903314 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895895    2581 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895898    2581 flags.go:64] FLAG: --reserved-memory=""
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895901    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895905    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895908    2581 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895910    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895913    2581 flags.go:64] FLAG: --runonce="false"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895916    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895919    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895922    2581 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895925    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895928    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895932    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895935    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895938    2581 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895941    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895962    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895967    2581 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895970    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895974    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895978    2581 flags.go:64] FLAG: --system-cgroups=""
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895981    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895987    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895990    2581 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.895993    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 05:35:56.904351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896000    2581 flags.go:64] FLAG: --tls-min-version=""
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896003    2581 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896006    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896009    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896012    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896015    2581 flags.go:64] FLAG: --v="2"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896020    2581 flags.go:64] FLAG: --version="false"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896024    2581 flags.go:64] FLAG: --vmodule=""
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896027    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.896031    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896164    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896168    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896171    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896175    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896178    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896180    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896183    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896186    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896188    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896193    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896196    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.905342 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896201    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896204    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896206    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896209    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896211    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896214    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896218    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896222    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896225    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896227    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896230    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896233    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896235    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896238    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896240    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896243    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896245    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896248    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896251    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896253    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.905884 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896256    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896258    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896261    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896264    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896267    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896269    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896272    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896274    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896277    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896279    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896285    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896287    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896290    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896293    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896295    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896298    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896300    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896303    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896307    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.906635 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896311    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896315    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896318    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896322    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896325    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896328    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896331    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896333    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896336    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896339    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896341    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896344    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896346    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896349    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896351    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896354    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896356    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896359    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896361    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896364    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.907524 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896367    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896369    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896371    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896375    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896378    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896380    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896383    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896386    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896388    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896391    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896393    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896398    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896400    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896403    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896406    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896409    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896411    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896415    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896418    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.908083 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896421    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896424    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896427    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896430    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896432    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896435    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896438    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896440    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896443    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.896446    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.897184    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.905149    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.905170    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.906093    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.906110    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 05:35:56.908759 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906201    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906209    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906214    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906220    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906225    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906230    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906235    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906239    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906244    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906249    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906253    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906257    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906261    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906266    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906271    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906278    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906284    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906289    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906294    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906299    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.909435 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906303    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906308    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906312    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906316    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906321    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906325    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906329    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906333    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906337    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906344    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906349    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906353    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906357    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906361    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906366    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906370    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906374    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906378    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906382    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906386    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.910072 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906391    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906395    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906400    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906404    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906408    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906413    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906417    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906421    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906425    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906429    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906433    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906438    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906442    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906446    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906450    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906454    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906459    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906463    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906467    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.910554 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906471    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906477    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906485    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906490    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906494    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906498    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906503    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906507    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906511    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906515    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906519    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906523    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906528    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906532    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906536    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906540    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906545    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906549    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906553    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906558    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.911169 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906562    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906566    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906570    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906574    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906579    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906583    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906587    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906591    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906595    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906599    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906603    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906607    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906611    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906616    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906620    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906627    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906633    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906637    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906641    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.911790 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906645    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.906653    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906842    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906851    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906857    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906861    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906866    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906870    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906875    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906880    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906884    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906888    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906893    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906897    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906901    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 05:35:56.912301 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906905    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906910    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906916    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906923    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906928    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906932    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906936    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906940    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906960    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906965    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906969    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906973    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906977    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906983    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906990    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906995    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.906999    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907003    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907007    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 05:35:56.912671 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907012    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907016    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907020    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907024    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907028    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907033    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907037    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907041    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907046    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907050    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907054    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907058    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907064    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907070    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907074    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907079    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907084    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907089    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907093    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 05:35:56.913354 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907097    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907101    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907105    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907110    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907114    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907118    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907126    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907130    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907134    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907138    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907143    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907147    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907151    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907155    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907159    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907163    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907167    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907171    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907175    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 05:35:56.913813 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907180    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907184    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907187    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907192    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907196    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907201    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907205    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907209    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907213    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907217    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907222    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907226    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907231    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907235    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907240    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907244    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907248    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907252    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907256    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907261    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 05:35:56.914369 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907265    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907269    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907273    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907279    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907283    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907287    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907292    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:56.907296    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.907303    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.907475    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.911378    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.913200    2581 server.go:1019] "Starting client certificate rotation"
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.913303    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 05:35:56.914861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.913336    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 05:35:56.916349 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.916331    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 05:35:56.920281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.920259    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 05:35:56.933518 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.933498    2581 log.go:25] "Validated CRI v1 runtime API"
Aug 05 05:35:56.935896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.935878    2581 log.go:25] "Validated CRI v1 image API"
Aug 05 05:35:56.937479 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.937465    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 05:35:56.943053 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.943032    2581 fs.go:135] Filesystem UUIDs: map[5c25221b-5477-40c0-b90d-286c80b3f63e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 805ef019-aafd-46dd-bca8-a0729a1e9899:/dev/nvme0n1p3]
Aug 05 05:35:56.943116 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.943051    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 05:35:56.946385 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.946367    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 05:35:56.947346 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.947241    2581 manager.go:216] Machine: {Timestamp:2026-08-05 05:35:56.946750868 +0000 UTC m=+0.356409807 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099562 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1731452974da9af60cb4a26de78e SystemUUID:ec2d1731-4529-74da-9af6-0cb4a26de78e BootID:1ef5dc53-deb7-4e3b-96aa-bd8a59c776e6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9c:23:3b:dc:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9c:23:3b:dc:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:8b:c6:8a:03:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 05:35:56.947346 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.947341    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 05:35:56.947474 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.947416    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 05:35:56.951156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.951132    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 05:35:56.951318 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.951160    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 05:35:56.952808 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.952795    2581 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 05:35:56.952864 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.952814    2581 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 05:35:56.952864 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.952832    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 05:35:56.953453 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.953440    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 05:35:56.954612 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.954601    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 05:35:56.958940 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.958926    2581 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 05:35:56.959097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959085    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 05:35:56.959156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959125    2581 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 05:35:56.959156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959142    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 05:35:56.959242 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959160    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 05:35:56.959242 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959174    2581 kubelet.go:398] "Adding apiserver pod source"
Aug 05 05:35:56.959242 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959186    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 05:35:56.959619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959604    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 05:35:56.959619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.959629    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 05:35:56.962140 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.962126    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 05:35:56.967109 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.967069    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 05:35:56.967196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.967135    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968714    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968733    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968740    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968746    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968758    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 05:35:56.968759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968767    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968775    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968781    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968788    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968794    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968802    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 05:35:56.968985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.968807    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 05:35:56.970528 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.970516    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 05:35:56.970573 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.970531    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 05:35:56.972617 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.972590    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 05:35:56.972671 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.972590    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 05:35:56.973853 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.973840    2581 server.go:1268] "Started kubelet"
Aug 05 05:35:56.974004 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.973964    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 05:35:56.974069 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.973934    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 05:35:56.974069 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.974058    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 05:35:56.974794 ip-10-0-134-152 systemd[1]: Started Kubernetes Kubelet.
Aug 05 05:35:56.975531 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.975515    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 05:35:56.976214 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.976199    2581 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 05:35:56.981121 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.979770    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 05:35:56.981121 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.980474    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 05:35:56.981581 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.980388    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b1e5985f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:56.973815903 +0000 UTC m=+0.383474842,LastTimestamp:2026-08-05 05:35:56.973815903 +0000 UTC m=+0.383474842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:56.982712 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.982699    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 05:35:56.982767 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.982721    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 05:35:56.982854 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.982837    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:56.983524 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.983507    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 05:35:56.983609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.983510    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 05:35:56.983609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.983540    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 05:35:56.983696 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.983643    2581 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 05:35:56.983696 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.983651    2581 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 05:35:56.985051 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985027    2581 factory.go:55] Registering systemd factory
Aug 05 05:35:56.985051 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985046    2581 factory.go:223] Registration of the systemd container factory successfully
Aug 05 05:35:56.985388 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985370    2581 factory.go:153] Registering CRI-O factory
Aug 05 05:35:56.985388 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985387    2581 factory.go:223] Registration of the crio container factory successfully
Aug 05 05:35:56.985531 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985436    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 05:35:56.985531 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985465    2581 factory.go:103] Registering Raw factory
Aug 05 05:35:56.985531 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.985488    2581 manager.go:1196] Started watching for new ooms in manager
Aug 05 05:35:56.986129 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.986103    2581 manager.go:349] Starting recovery of all containers
Aug 05 05:35:56.986875 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.986853    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 05:35:56.986963 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:56.986908    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 05:35:56.994846 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.994823    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pqgkp"
Aug 05 05:35:56.998134 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:56.998116    2581 manager.go:354] Recovery completed
Aug 05 05:35:57.003459 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.003447    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.004235 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.004149    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pqgkp"
Aug 05 05:35:57.005548 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.005526    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.005621 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.005563    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.005621 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.005578    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.006134 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006117    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 05:35:57.006134 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006131    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.006255 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006132    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 05:35:57.006255 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006226    2581 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 05:35:57.006895 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006877    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.006979 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006913    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.006979 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.006936    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.007965 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.007867    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3c9c4a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.005546663 +0000 UTC m=+0.415205602,LastTimestamp:2026-08-05 05:35:57.005546663 +0000 UTC m=+0.415205602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.018120 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.018051    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3ca1fdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.005570015 +0000 UTC m=+0.415228957,LastTimestamp:2026-08-05 05:35:57.005570015 +0000 UTC m=+0.415228957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.026422 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.026351    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3ca53a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.00558327 +0000 UTC m=+0.415242213,LastTimestamp:2026-08-05 05:35:57.00558327 +0000 UTC m=+0.415242213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.036014 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.035955    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-152.ec2.internal.18c8d201b3c9c4a7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3c9c4a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.005546663 +0000 UTC m=+0.415205602,LastTimestamp:2026-08-05 05:35:57.006896191 +0000 UTC m=+0.416555135,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.047015 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.046938    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-152.ec2.internal.18c8d201b3ca1fdf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3ca1fdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.005570015 +0000 UTC m=+0.415228957,LastTimestamp:2026-08-05 05:35:57.006920236 +0000 UTC m=+0.416579183,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.058598 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.058532    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-152.ec2.internal.18c8d201b3ca53a6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c8d201b3ca53a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-08-05 05:35:57.00558327 +0000 UTC m=+0.415242213,LastTimestamp:2026-08-05 05:35:57.006961279 +0000 UTC m=+0.416620219,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Aug 05 05:35:57.083693 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.083672    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.159485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.159415    2581 policy_none.go:49] "None policy: Start"
Aug 05 05:35:57.159485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.159445    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 05:35:57.159604 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.159491    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 05:35:57.160686 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.160672    2581 policy_none.go:47] "Start"
Aug 05 05:35:57.183852 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.183834    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.198354 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198341    2581 manager.go:337] "Starting Device Plugin manager"
Aug 05 05:35:57.198425 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.198380    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 05:35:57.198425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198394    2581 server.go:87] "Starting device plugin registration server"
Aug 05 05:35:57.198666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198653    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 05:35:57.198738 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198668    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 05:35:57.198789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198756    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 05:35:57.198881 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198838    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 05:35:57.198881 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.198849    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 05:35:57.199475 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.199454    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 05:35:57.199541 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.199513    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.200715 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.200699    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.233983 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.233828    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 05:35:57.235290 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.235275    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 05:35:57.235362 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.235309    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 05:35:57.235362 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.235331    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 05:35:57.235362 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.235360    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 05:35:57.237742 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.237722    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 05:35:57.299049 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.299020    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.300069 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.300052    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.300139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.300083    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.300139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.300094    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.300139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.300125    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.311254 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.311238    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.311302 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.311261    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-152.ec2.internal\": node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.326668 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.326649    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.335998 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.335972    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"]
Aug 05 05:35:57.336046 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.336037    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.336768 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.336754    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.336817 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.336779    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.336817 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.336790    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.338112 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338100    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.338235 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.338271 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338250    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.338784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338767    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.338845 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338805    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.338845 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.338823    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.339226 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.339212    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.339288 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.339235    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.339288 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.339246    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.340127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.340115    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.340230 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.340139    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:57.340764 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.340750    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:57.340854 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.340776    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:57.340854 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.340790    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:57.355548 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.355527    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.360025 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.360009    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.385029 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.384998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f5034d73fabec3b6e22ad6386ac3fa-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"98f5034d73fabec3b6e22ad6386ac3fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.385097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.385034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.385097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.385051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.427246 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.427200    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.486144 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.486241 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.486241 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f5034d73fabec3b6e22ad6386ac3fa-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"98f5034d73fabec3b6e22ad6386ac3fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.486241 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.486241 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98f5034d73fabec3b6e22ad6386ac3fa-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"98f5034d73fabec3b6e22ad6386ac3fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.486372 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.486213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7759f5d0a1f754eef265f3848c66e688-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"7759f5d0a1f754eef265f3848c66e688\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.528246 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.528227    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.628798 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.628762    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.658978 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.658937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.662176 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.662155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:57.729787 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.729758    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.830738 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.830708    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:57.912932 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.912885    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 05:35:57.913425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:57.913066    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 05:35:57.931125 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:57.931096    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:58.031942 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.031905    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:58.049551 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.049527    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 05:35:58.050562 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.050545    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 05:35:58.050665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.050576    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 05:35:58.050665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.050591    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Aug 05 05:35:58.132519 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.132478    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:58.160644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.160600    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 05:30:57 +0000 UTC" deadline="2028-04-02 16:14:27.027174388 +0000 UTC"
Aug 05 05:35:58.160644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.160640    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14554h38m28.866537904s"
Aug 05 05:35:58.212987 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:58.212933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f5034d73fabec3b6e22ad6386ac3fa.slice/crio-80583569fa0bacaf45f41a5d2b17a369d3d6be9f6195968f0e72c64314b433c4 WatchSource:0}: Error finding container 80583569fa0bacaf45f41a5d2b17a369d3d6be9f6195968f0e72c64314b433c4: Status 404 returned error can't find the container with id 80583569fa0bacaf45f41a5d2b17a369d3d6be9f6195968f0e72c64314b433c4
Aug 05 05:35:58.213448 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:35:58.213422    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7759f5d0a1f754eef265f3848c66e688.slice/crio-8ae6acf689b3ead53e3a7b7022a4fca5e2a8391bebdd7daa45fd885186343a07 WatchSource:0}: Error finding container 8ae6acf689b3ead53e3a7b7022a4fca5e2a8391bebdd7daa45fd885186343a07: Status 404 returned error can't find the container with id 8ae6acf689b3ead53e3a7b7022a4fca5e2a8391bebdd7daa45fd885186343a07
Aug 05 05:35:58.219133 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.219117    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 05:35:58.233085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.233065    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:58.238688 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.238639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"7759f5d0a1f754eef265f3848c66e688","Type":"ContainerStarted","Data":"8ae6acf689b3ead53e3a7b7022a4fca5e2a8391bebdd7daa45fd885186343a07"}
Aug 05 05:35:58.239726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.239706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"98f5034d73fabec3b6e22ad6386ac3fa","Type":"ContainerStarted","Data":"80583569fa0bacaf45f41a5d2b17a369d3d6be9f6195968f0e72c64314b433c4"}
Aug 05 05:35:58.336076 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.335979    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Aug 05 05:35:58.355056 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.355030    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 05:35:58.384414 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.384389    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:58.401689 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.401668    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 05:35:58.403515 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.403501    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Aug 05 05:35:58.414199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.414182    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 05:35:58.479956 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.479930    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 05:35:58.480733 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.480718    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 05:35:58.961713 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.961668    2581 apiserver.go:52] "Watching apiserver"
Aug 05 05:35:58.968588 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.968394    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 05:35:58.968920 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.968892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9cdl2","kube-system/konnectivity-agent-hcrkv","kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4","openshift-cluster-node-tuning-operator/tuned-sx8xw","openshift-image-registry/node-ca-5brmv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal","openshift-multus/multus-additional-cni-plugins-htts4","openshift-multus/multus-ml2pt","openshift-multus/network-metrics-daemon-47xz4","openshift-network-diagnostics/network-check-target-fdw26","openshift-network-operator/iptables-alerter-9ntns","openshift-ovn-kubernetes/ovnkube-node-26cn6"]
Aug 05 05:35:58.970841 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.970816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:58.970946 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.970915    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:35:58.972381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.972361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:58.973733 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.973376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.975603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.975253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r8mgk\""
Aug 05 05:35:58.975603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.975385    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 05:35:58.975603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.975395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 05:35:58.975603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.975459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 05:35:58.975856 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.975611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.976173 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.976150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:58.976404 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.976384    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.976828 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.976807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6x2fd\""
Aug 05 05:35:58.977106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.977088    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.977453 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.977436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.978335 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2qgv\""
Aug 05 05:35:58.978335 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978191    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.978335 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978233    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.978335 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.978726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978467    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 05:35:58.978726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978492    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-twjds\""
Aug 05 05:35:58.978726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978489    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.978872 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.978858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.979518 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.979500    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 05:35:58.979744 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.979726    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 05:35:58.979957 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.979925    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 05:35:58.979957 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.979940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wfw74\""
Aug 05 05:35:58.980435 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.980415    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.980435 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.980433    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.980777 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.980758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:58.980854 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.980822    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:35:58.981386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.981361    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 05:35:58.981617 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.981603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6spks\""
Aug 05 05:35:58.982543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.982407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:35:58.982543 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:58.982466    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:35:58.984656 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.984134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:58.984656 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.984192    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 05:35:58.985791 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.985614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.987156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.986805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.988849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.987380    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 05:35:58.988849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.987609    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.988849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.987949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7x959\""
Aug 05 05:35:58.988849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.988660    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 05:35:58.989095 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.988945    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 05:35:58.989789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.989195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bz4wm\""
Aug 05 05:35:58.989789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.989354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 05:35:58.989789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.989614    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 05:35:58.989789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.989673    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 05:35:58.989789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.989692    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 05:35:58.994073 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994189 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-multus\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994189 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-kubelet\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994189 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-socket-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.994189 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-os-release\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb10bf-2662-40a6-9fdc-de398cdc4184-konnectivity-ca\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-device-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-modprobe-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-var-lib-kubelet\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzmq\" (UniqueName: \"kubernetes.io/projected/49950f58-2f12-4c00-b94f-73619af12961-kube-api-access-rwzmq\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.994400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21ed34a4-0787-4540-8e68-9e60e18b794d-serviceca\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-dbus\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-var-lib-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-config\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-env-overrides\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovn-node-metrics-cert\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sh2s\" (UniqueName: \"kubernetes.io/projected/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kube-api-access-2sh2s\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-conf-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnsl\" (UniqueName: \"kubernetes.io/projected/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-kube-api-access-zdnsl\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-run\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-lib-modules\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.994741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-netns\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-kubelet-config\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-ovn\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cb10bf-2662-40a6-9fdc-de398cdc4184-agent-certs\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4s5h\" (UniqueName: \"kubernetes.io/projected/805c01e7-c721-410e-a13a-09bd4987a46c-kube-api-access-p4s5h\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-system-cni-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.994985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-cnibin\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-slash\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-script-lib\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-sys\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cni-binary-copy\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-sys-fs\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vncsq\" (UniqueName: \"kubernetes.io/projected/21ed34a4-0787-4540-8e68-9e60e18b794d-kube-api-access-vncsq\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:58.995386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cnibin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-etc-kubernetes\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-systemd-units\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-etc-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-netd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-kubernetes\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-binary-copy\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-log-socket\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-registration-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-bin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-os-release\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.996196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-bin\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8gt\" (UniqueName: \"kubernetes.io/projected/b994f761-fea3-41b7-a35d-79a4fbc40cc0-kube-api-access-5q8gt\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-tmp\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21ed34a4-0787-4540-8e68-9e60e18b794d-host\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/805c01e7-c721-410e-a13a-09bd4987a46c-iptables-alerter-script\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxng\" (UniqueName: \"kubernetes.io/projected/cd276d1c-739b-441a-862c-d8e0f9931d69-kube-api-access-frxng\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-netns\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tdvv\" (UniqueName: \"kubernetes.io/projected/8d5d27ff-1728-4820-a619-935ef6094cd9-kube-api-access-4tdvv\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.995990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-node-log\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-hostroot\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-daemon-config\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-multus-certs\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-conf\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-host\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-etc-tuned\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-socket-dir-parent\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.997177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-k8s-cni-cncf-io\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-systemd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysconfig\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-systemd\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-system-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/805c01e7-c721-410e-a13a-09bd4987a46c-host-slash\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-kubelet\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:58.998192 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:58.996471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:59.003109 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.001634    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 05:35:59.023539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.023496    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bv4rn"
Aug 05 05:35:59.033305 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.033282    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bv4rn"
Aug 05 05:35:59.084968 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.084947    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 05:35:59.096667 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cnibin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.096773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cnibin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.096773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-etc-kubernetes\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.096773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-systemd-units\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.096773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-etc-kubernetes\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-etc-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-systemd-units\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-etc-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-netd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-kubernetes\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-netd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-binary-copy\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:35:59.097017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.096928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-kubernetes\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.097525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-log-socket\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-cni-binary-copy\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-registration-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.097682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.097682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-bin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-os-release\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-bin\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-registration-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-bin\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-cni-bin\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-os-release\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8gt\" (UniqueName: \"kubernetes.io/projected/b994f761-fea3-41b7-a35d-79a4fbc40cc0-kube-api-access-5q8gt\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-tmp\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21ed34a4-0787-4540-8e68-9e60e18b794d-host\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/805c01e7-c721-410e-a13a-09bd4987a46c-iptables-alerter-script\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.097943 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-log-socket\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21ed34a4-0787-4540-8e68-9e60e18b794d-host\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097839    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.097991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxng\" (UniqueName: \"kubernetes.io/projected/cd276d1c-739b-441a-862c-d8e0f9931d69-kube-api-access-frxng\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-netns\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tdvv\" (UniqueName: \"kubernetes.io/projected/8d5d27ff-1728-4820-a619-935ef6094cd9-kube-api-access-4tdvv\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-netns\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-node-log\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-hostroot\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-daemon-config\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098183    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-multus-certs\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-conf\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-hostroot\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-host\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd276d1c-739b-441a-862c-d8e0f9931d69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-etc-tuned\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-node-log\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.098560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-multus-certs\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-socket-dir-parent\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-k8s-cni-cncf-io\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-systemd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysctl-conf\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-socket-dir-parent\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098467    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-k8s-cni-cncf-io\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-systemd\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.099485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-daemon-config\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysconfig\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-host\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-sysconfig\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-systemd\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-system-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/805c01e7-c721-410e-a13a-09bd4987a46c-host-slash\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-kubelet\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-multus\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.099992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.099984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-kubelet\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-socket-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-os-release\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb10bf-2662-40a6-9fdc-de398cdc4184-konnectivity-ca\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-device-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-modprobe-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-var-lib-kubelet\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzmq\" (UniqueName: \"kubernetes.io/projected/49950f58-2f12-4c00-b94f-73619af12961-kube-api-access-rwzmq\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21ed34a4-0787-4540-8e68-9e60e18b794d-serviceca\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-dbus\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-var-lib-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-config\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.100445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-env-overrides\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovn-node-metrics-cert\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sh2s\" (UniqueName: \"kubernetes.io/projected/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kube-api-access-2sh2s\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-conf-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnsl\" (UniqueName: \"kubernetes.io/projected/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-kube-api-access-zdnsl\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-run\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-lib-modules\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-netns\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-kubelet-config\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-ovn\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cb10bf-2662-40a6-9fdc-de398cdc4184-agent-certs\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4s5h\" (UniqueName: \"kubernetes.io/projected/805c01e7-c721-410e-a13a-09bd4987a46c-kube-api-access-p4s5h\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-system-cni-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-cnibin\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-slash\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.101141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-script-lib\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-sys\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-systemd\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cni-binary-copy\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-sys-fs\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vncsq\" (UniqueName: \"kubernetes.io/projected/21ed34a4-0787-4540-8e68-9e60e18b794d-kube-api-access-vncsq\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-kubelet\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.101490    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-system-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.098520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/805c01e7-c721-410e-a13a-09bd4987a46c-iptables-alerter-script\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.101571    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:35:59.601549056 +0000 UTC m=+3.011208004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-kubelet\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-run\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-var-lib-cni-multus\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-lib-modules\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-kubelet-config\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.102009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-var-lib-kubelet\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.101995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-ovn\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-socket-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-cnibin\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-os-release\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.100045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/805c01e7-c721-410e-a13a-09bd4987a46c-host-slash\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-run-ovn-kubernetes\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.102977 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.102846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-sys\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.103464 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.103304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-cni-binary-copy\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.103464 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.103366    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-sys-fs\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.103464 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.103403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cb10bf-2662-40a6-9fdc-de398cdc4184-konnectivity-ca\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:59.103678 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.103478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-host-slash\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.103738 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.103718    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:35:59.103738 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.103734    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:35:59.103840 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.103743    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:35:59.103840 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.103788    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:35:59.603776791 +0000 UTC m=+3.013435732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.103968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-etc-tuned\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21ed34a4-0787-4540-8e68-9e60e18b794d-serviceca\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-script-lib\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-conf-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-dbus\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/686ee3ba-037b-4324-86c0-7c46e4c4fc31-device-dir\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104315    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-var-lib-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b994f761-fea3-41b7-a35d-79a4fbc40cc0-run-openvswitch\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104372    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49950f58-2f12-4c00-b94f-73619af12961-etc-modprobe-d\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.104527 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-multus-cni-dir\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.104959 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.104818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovnkube-config\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.106232 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.105712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-host-run-netns\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.106232 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.106009    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:35:59.106232 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.106094    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:35:59.606076314 +0000 UTC m=+3.015735266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:35:59.106232 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.106151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd276d1c-739b-441a-862c-d8e0f9931d69-system-cni-dir\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.106232 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.106378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b994f761-fea3-41b7-a35d-79a4fbc40cc0-env-overrides\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.107310 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.107236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cb10bf-2662-40a6-9fdc-de398cdc4184-agent-certs\") pod \"konnectivity-agent-hcrkv\" (UID: \"f7cb10bf-2662-40a6-9fdc-de398cdc4184\") " pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:59.107310 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.107269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49950f58-2f12-4c00-b94f-73619af12961-tmp\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.107478 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.107414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxng\" (UniqueName: \"kubernetes.io/projected/cd276d1c-739b-441a-862c-d8e0f9931d69-kube-api-access-frxng\") pod \"multus-additional-cni-plugins-htts4\" (UID: \"cd276d1c-739b-441a-862c-d8e0f9931d69\") " pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.107539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.107416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b994f761-fea3-41b7-a35d-79a4fbc40cc0-ovn-node-metrics-cert\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.108140 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.108089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tdvv\" (UniqueName: \"kubernetes.io/projected/8d5d27ff-1728-4820-a619-935ef6094cd9-kube-api-access-4tdvv\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:59.110129 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.109754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8gt\" (UniqueName: \"kubernetes.io/projected/b994f761-fea3-41b7-a35d-79a4fbc40cc0-kube-api-access-5q8gt\") pod \"ovnkube-node-26cn6\" (UID: \"b994f761-fea3-41b7-a35d-79a4fbc40cc0\") " pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.110775 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.110751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnsl\" (UniqueName: \"kubernetes.io/projected/59ade31a-4ad8-4564-87c1-d6e4dcda15d3-kube-api-access-zdnsl\") pod \"multus-ml2pt\" (UID: \"59ade31a-4ad8-4564-87c1-d6e4dcda15d3\") " pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.111250 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.111231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vncsq\" (UniqueName: \"kubernetes.io/projected/21ed34a4-0787-4540-8e68-9e60e18b794d-kube-api-access-vncsq\") pod \"node-ca-5brmv\" (UID: \"21ed34a4-0787-4540-8e68-9e60e18b794d\") " pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.113542 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.113520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzmq\" (UniqueName: \"kubernetes.io/projected/49950f58-2f12-4c00-b94f-73619af12961-kube-api-access-rwzmq\") pod \"tuned-sx8xw\" (UID: \"49950f58-2f12-4c00-b94f-73619af12961\") " pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.118113 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.118087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4s5h\" (UniqueName: \"kubernetes.io/projected/805c01e7-c721-410e-a13a-09bd4987a46c-kube-api-access-p4s5h\") pod \"iptables-alerter-9ntns\" (UID: \"805c01e7-c721-410e-a13a-09bd4987a46c\") " pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.119412 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.119387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sh2s\" (UniqueName: \"kubernetes.io/projected/686ee3ba-037b-4324-86c0-7c46e4c4fc31-kube-api-access-2sh2s\") pod \"aws-ebs-csi-driver-node-9gxm4\" (UID: \"686ee3ba-037b-4324-86c0-7c46e4c4fc31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.292185 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.292148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:35:59.301562 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.301512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4"
Aug 05 05:35:59.311573 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.311543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sx8xw"
Aug 05 05:35:59.319300 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.319277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5brmv"
Aug 05 05:35:59.328381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.328336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htts4"
Aug 05 05:35:59.337283 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.337260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ml2pt"
Aug 05 05:35:59.347052 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.347033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ntns"
Aug 05 05:35:59.353506 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.353488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:35:59.371697 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.371674    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 05:35:59.604975 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.604887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:35:59.604975 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.604943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:35:59.605160 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605066    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:35:59.605160 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605092    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:35:59.605160 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605117    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:35:59.605160 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605133    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:35:59.605280 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605133    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:00.605115145 +0000 UTC m=+4.014774094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:35:59.605280 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.605214    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:36:00.605196737 +0000 UTC m=+4.014855677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:35:59.706096 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:35:59.706064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:35:59.706282 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.706202    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:35:59.706282 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:35:59.706273    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:36:00.706252451 +0000 UTC m=+4.115911379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:00.036327 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:00.036285    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 05:30:59 +0000 UTC" deadline="2028-04-21 00:48:16.66101743 +0000 UTC"
Aug 05 05:36:00.036327 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:00.036318    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14995h12m16.624703499s"
Aug 05 05:36:00.313350 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.313150    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ade31a_4ad8_4564_87c1_d6e4dcda15d3.slice/crio-cd0c56aca8ddeca5612f99c63da923ce79b01312c274dbaa6755fa4ce9cf4e1f WatchSource:0}: Error finding container cd0c56aca8ddeca5612f99c63da923ce79b01312c274dbaa6755fa4ce9cf4e1f: Status 404 returned error can't find the container with id cd0c56aca8ddeca5612f99c63da923ce79b01312c274dbaa6755fa4ce9cf4e1f
Aug 05 05:36:00.315068 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.315041    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686ee3ba_037b_4324_86c0_7c46e4c4fc31.slice/crio-42bb3baa01c217c6bc86171fb54bf68adf703fb2ffd212951727040d51442be8 WatchSource:0}: Error finding container 42bb3baa01c217c6bc86171fb54bf68adf703fb2ffd212951727040d51442be8: Status 404 returned error can't find the container with id 42bb3baa01c217c6bc86171fb54bf68adf703fb2ffd212951727040d51442be8
Aug 05 05:36:00.315919 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.315886    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49950f58_2f12_4c00_b94f_73619af12961.slice/crio-c203853b3f6d43645c8ba46c236f2a1dc8f94018fd98cfdfc07cec30ae986538 WatchSource:0}: Error finding container c203853b3f6d43645c8ba46c236f2a1dc8f94018fd98cfdfc07cec30ae986538: Status 404 returned error can't find the container with id c203853b3f6d43645c8ba46c236f2a1dc8f94018fd98cfdfc07cec30ae986538
Aug 05 05:36:00.318529 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.318491    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ed34a4_0787_4540_8e68_9e60e18b794d.slice/crio-67b1ef5e3190ff786720e908598850a4334614aaf1519818a0468177494c9250 WatchSource:0}: Error finding container 67b1ef5e3190ff786720e908598850a4334614aaf1519818a0468177494c9250: Status 404 returned error can't find the container with id 67b1ef5e3190ff786720e908598850a4334614aaf1519818a0468177494c9250
Aug 05 05:36:00.323126 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.323103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cb10bf_2662_40a6_9fdc_de398cdc4184.slice/crio-efd5f15885fb6f5651e8aa9fc6f479ee59f179221cb2240d2b1fd1dab8bca5dc WatchSource:0}: Error finding container efd5f15885fb6f5651e8aa9fc6f479ee59f179221cb2240d2b1fd1dab8bca5dc: Status 404 returned error can't find the container with id efd5f15885fb6f5651e8aa9fc6f479ee59f179221cb2240d2b1fd1dab8bca5dc
Aug 05 05:36:00.325118 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.324174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805c01e7_c721_410e_a13a_09bd4987a46c.slice/crio-099d06ca915ca5c8c6a6797027075541ae33c69eaaa1151490a3ee87979be1df WatchSource:0}: Error finding container 099d06ca915ca5c8c6a6797027075541ae33c69eaaa1151490a3ee87979be1df: Status 404 returned error can't find the container with id 099d06ca915ca5c8c6a6797027075541ae33c69eaaa1151490a3ee87979be1df
Aug 05 05:36:00.326632 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.326410    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb994f761_fea3_41b7_a35d_79a4fbc40cc0.slice/crio-a4cf240abdca9cb91c1b82d058b683c8aff8e1d54f3b2800750d53ceda610caa WatchSource:0}: Error finding container a4cf240abdca9cb91c1b82d058b683c8aff8e1d54f3b2800750d53ceda610caa: Status 404 returned error can't find the container with id a4cf240abdca9cb91c1b82d058b683c8aff8e1d54f3b2800750d53ceda610caa
Aug 05 05:36:00.327206 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:00.327182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd276d1c_739b_441a_862c_d8e0f9931d69.slice/crio-df79b12c9eca615e39c1a10fed72643df9446916e2c96afde849e970f655bc58 WatchSource:0}: Error finding container df79b12c9eca615e39c1a10fed72643df9446916e2c96afde849e970f655bc58: Status 404 returned error can't find the container with id df79b12c9eca615e39c1a10fed72643df9446916e2c96afde849e970f655bc58
Aug 05 05:36:00.613372 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:00.613208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:00.613468 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:00.613416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:00.613468 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613355    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:00.613544 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613500    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:02.613482845 +0000 UTC m=+6.023141791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:00.613544 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613522    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:36:00.613544 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613537    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:36:00.613655 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613546    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:00.613655 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.613582    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:36:02.613571246 +0000 UTC m=+6.023230174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:00.714816 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:00.714786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:00.715007 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.714895    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:00.715007 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:00.714953    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:36:02.714938842 +0000 UTC m=+6.124597770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:01.037525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.037477    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 05:30:59 +0000 UTC" deadline="2028-01-16 08:11:55.004718005 +0000 UTC"
Aug 05 05:36:01.037525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.037521    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12698h35m53.967201683s"
Aug 05 05:36:01.235801 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.235741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:01.236280 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:01.236234    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:01.236755 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.236737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:01.237177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.237155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:01.237302 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:01.237280    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:01.237393 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:01.237375    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:01.254816 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.254167    2581 generic.go:356] "Generic (PLEG): container finished" podID="7759f5d0a1f754eef265f3848c66e688" containerID="df89bb32ff97763cc4602aa9cc4e1de34655b3a71b5c0f98fa3be0022dfed320" exitCode=0
Aug 05 05:36:01.254930 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.254244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"7759f5d0a1f754eef265f3848c66e688","Type":"ContainerDied","Data":"df89bb32ff97763cc4602aa9cc4e1de34655b3a71b5c0f98fa3be0022dfed320"}
Aug 05 05:36:01.261480 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.261409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ntns" event={"ID":"805c01e7-c721-410e-a13a-09bd4987a46c","Type":"ContainerStarted","Data":"099d06ca915ca5c8c6a6797027075541ae33c69eaaa1151490a3ee87979be1df"}
Aug 05 05:36:01.276389 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.276363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcrkv" event={"ID":"f7cb10bf-2662-40a6-9fdc-de398cdc4184","Type":"ContainerStarted","Data":"efd5f15885fb6f5651e8aa9fc6f479ee59f179221cb2240d2b1fd1dab8bca5dc"}
Aug 05 05:36:01.283613 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.283589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sx8xw" event={"ID":"49950f58-2f12-4c00-b94f-73619af12961","Type":"ContainerStarted","Data":"c203853b3f6d43645c8ba46c236f2a1dc8f94018fd98cfdfc07cec30ae986538"}
Aug 05 05:36:01.307919 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.307854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"98f5034d73fabec3b6e22ad6386ac3fa","Type":"ContainerStarted","Data":"4fdb8ba9729a751fb58b2a3f0f6698f6d6261ed5b6508a00c182749f687cc351"}
Aug 05 05:36:01.320902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.320874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"a4cf240abdca9cb91c1b82d058b683c8aff8e1d54f3b2800750d53ceda610caa"}
Aug 05 05:36:01.334442 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.334417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerStarted","Data":"df79b12c9eca615e39c1a10fed72643df9446916e2c96afde849e970f655bc58"}
Aug 05 05:36:01.349739 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.349636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5brmv" event={"ID":"21ed34a4-0787-4540-8e68-9e60e18b794d","Type":"ContainerStarted","Data":"67b1ef5e3190ff786720e908598850a4334614aaf1519818a0468177494c9250"}
Aug 05 05:36:01.356029 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.356001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4" event={"ID":"686ee3ba-037b-4324-86c0-7c46e4c4fc31","Type":"ContainerStarted","Data":"42bb3baa01c217c6bc86171fb54bf68adf703fb2ffd212951727040d51442be8"}
Aug 05 05:36:01.376648 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:01.376622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ml2pt" event={"ID":"59ade31a-4ad8-4564-87c1-d6e4dcda15d3","Type":"ContainerStarted","Data":"cd0c56aca8ddeca5612f99c63da923ce79b01312c274dbaa6755fa4ce9cf4e1f"}
Aug 05 05:36:02.387088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:02.387053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"7759f5d0a1f754eef265f3848c66e688","Type":"ContainerStarted","Data":"dc1805b283698dc5205e562a6a7805eeb1a600d49f9bd3cbc7deb1406bd8f84f"}
Aug 05 05:36:02.402394 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:02.402338    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" podStartSLOduration=3.402318693 podStartE2EDuration="3.402318693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:01.323882984 +0000 UTC m=+4.733541939" watchObservedRunningTime="2026-08-05 05:36:02.402318693 +0000 UTC m=+5.811977646"
Aug 05 05:36:02.631114 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:02.631074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:02.631292 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:02.631148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:02.631371 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631292    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:02.631371 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631363    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:06.631339299 +0000 UTC m=+10.040998251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:02.631901 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631879    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:36:02.631901 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631904    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:36:02.632111 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631918    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:02.632111 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.631965    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:36:06.631948198 +0000 UTC m=+10.041607132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:02.733763 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:02.733724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:02.733955 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.733926    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:02.734098 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:02.734012    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:36:06.733973664 +0000 UTC m=+10.143632608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:03.237154 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:03.237119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:03.237352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:03.237166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:03.237352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:03.237130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:03.237352 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:03.237283    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:03.237528 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:03.237367    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:03.237592 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:03.237539    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:05.238310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:05.238452    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:05.238948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:05.239121    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:05.239191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:05.239368 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:05.239269    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:06.669235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:06.669331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.669497    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.669517    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.669531    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.669594    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:36:14.669574338 +0000 UTC m=+18.079233271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.670045    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:06.670259 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.670095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:14.670079153 +0000 UTC m=+18.079738088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:06.770295 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:06.770252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:06.770501 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.770450    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:06.770567 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:06.770523    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:36:14.770502877 +0000 UTC m=+18.180161807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:07.240244 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:07.240208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:07.240443 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:07.240345    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:07.240443 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:07.240378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:07.240563 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:07.240513    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:07.240563 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:07.240540    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:07.240679 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:07.240608    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:09.236213 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:09.236172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:09.236761 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:09.236302    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:09.236761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:09.236693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:09.236844 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:09.236781    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:09.236844 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:09.236836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:09.236958 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:09.236916    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:11.236436 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:11.236399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:11.236436 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:11.236433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:11.236962 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:11.236399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:11.236962 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:11.236535    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:11.236962 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:11.236612    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:11.236962 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:11.236681    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:13.235612 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.235573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:13.236112 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.235573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:13.236112 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:13.235707    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:13.236112 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.235573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:13.236112 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:13.235810    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:13.236112 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:13.235853    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:13.741598 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.741544    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" podStartSLOduration=14.741528423 podStartE2EDuration="14.741528423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:02.403539244 +0000 UTC m=+5.813198197" watchObservedRunningTime="2026-08-05 05:36:13.741528423 +0000 UTC m=+17.151187349"
Aug 05 05:36:13.741869 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.741853    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9pgbw"]
Aug 05 05:36:13.756462 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.756437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.759038 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.759008    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 05:36:13.759397 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.759264    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76plb\""
Aug 05 05:36:13.759397 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.759292    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 05:36:13.828495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.828463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52m9j\" (UniqueName: \"kubernetes.io/projected/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-kube-api-access-52m9j\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.828631 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.828509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-tmp-dir\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.828631 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.828539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-hosts-file\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.929428 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.929385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52m9j\" (UniqueName: \"kubernetes.io/projected/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-kube-api-access-52m9j\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.929428 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.929427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-tmp-dir\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.929678 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.929463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-hosts-file\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.929678 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.929553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-hosts-file\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.929831 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.929804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-tmp-dir\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:13.941772 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:13.941747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52m9j\" (UniqueName: \"kubernetes.io/projected/4fc0f4e6-a22f-4087-a11a-dde36d4c22e6-kube-api-access-52m9j\") pod \"node-resolver-9pgbw\" (UID: \"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6\") " pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:14.067208 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:14.067131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9pgbw"
Aug 05 05:36:14.734658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:14.734634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:14.734678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734757    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734800    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:30.734788233 +0000 UTC m=+34.144447159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734813    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734837    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734850    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:14.735099 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.734929    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:36:30.734886909 +0000 UTC m=+34.144545849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:14.835657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:14.835628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:14.835789 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.835736    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:14.835789 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:14.835789    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:36:30.835772874 +0000 UTC m=+34.245431801 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:15.239076 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:15.239043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:15.239076 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:15.239072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:15.239316 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:15.239082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:15.239316 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:15.239155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:15.239316 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:15.239254    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:15.239445 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:15.239348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:17.239105 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:17.239075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:17.239541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:17.239074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:17.239541 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:17.239201    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:17.239541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:17.239074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:17.239541 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:17.239255    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:17.239541 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:17.239327    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:19.236244 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.235965    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:19.236968 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.235977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:19.236968 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:19.236347    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:19.236968 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.235979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:19.236968 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:19.236453    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:19.236968 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:19.236510    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:19.426833 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.426797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ml2pt" event={"ID":"59ade31a-4ad8-4564-87c1-d6e4dcda15d3","Type":"ContainerStarted","Data":"ff13c68915a49288090636852156f87a190a8f18cd7faf612ae040ef5e3cd8c0"}
Aug 05 05:36:19.428758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.428730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9pgbw" event={"ID":"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6","Type":"ContainerStarted","Data":"f147d9162d1fe683e48fe656b9e21ded91473e70c1e31e6739950f5d6b509d1d"}
Aug 05 05:36:19.428851 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.428779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9pgbw" event={"ID":"4fc0f4e6-a22f-4087-a11a-dde36d4c22e6","Type":"ContainerStarted","Data":"477adcf99480446f57ecc92fe02c9b5b35cea790830ee377340cfee00613f70d"}
Aug 05 05:36:19.430237 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.430179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcrkv" event={"ID":"f7cb10bf-2662-40a6-9fdc-de398cdc4184","Type":"ContainerStarted","Data":"36ab8b060cf97975f4da07ec7aa05c87b342acebf3aec0d20b898fd3afd3fc53"}
Aug 05 05:36:19.431612 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.431591    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sx8xw" event={"ID":"49950f58-2f12-4c00-b94f-73619af12961","Type":"ContainerStarted","Data":"451963257b332058d6c40ce05baf1c95e726dfa9602c057f85d6635daa37efd8"}
Aug 05 05:36:19.434475 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.434457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"522c2e28557a50622cc0c8fc262a0959107b49af85380ce2e2985551b14900ca"}
Aug 05 05:36:19.434562 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.434514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"bcc49666ab30e8bc90dec1a5296ce961b9557d5e0f6179d608c974f48098cadf"}
Aug 05 05:36:19.434562 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.434554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"a939fd86e1e94a58a64b5b6aae88b8b0868c7c1f134798dd871190e4ba9cdeb2"}
Aug 05 05:36:19.434632 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.434597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"d348b0972e84c3c172769b4bb055c2f8c20fa099d8e52cfcf87649f5420d55b0"}
Aug 05 05:36:19.434632 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.434626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"2439114fb377d8a7e56f3101a44127378c28e173350e7e71c0ab90913982b860"}
Aug 05 05:36:19.435754 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.435734    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="d4425516005d07ab3acf8ae16499577389f37816b17ea54833043f0af73e79a5" exitCode=0
Aug 05 05:36:19.435853 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.435793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"d4425516005d07ab3acf8ae16499577389f37816b17ea54833043f0af73e79a5"}
Aug 05 05:36:19.437111 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.437086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5brmv" event={"ID":"21ed34a4-0787-4540-8e68-9e60e18b794d","Type":"ContainerStarted","Data":"3bec6ca866aeee0c310b66fa72934dc09eca917c04096bb63898bd16b95e848c"}
Aug 05 05:36:19.438502 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.438485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4" event={"ID":"686ee3ba-037b-4324-86c0-7c46e4c4fc31","Type":"ContainerStarted","Data":"07d6a6df9ba976835d181a81d5d981d916a3c87352655874f71e7ce5a6497308"}
Aug 05 05:36:19.441167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.441133    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ml2pt" podStartSLOduration=2.915593904 podStartE2EDuration="21.441122429s" totalImagesPullingTime="18.525528525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:19.440816419 +0000 UTC m=+22.850475369" watchObservedRunningTime="2026-08-05 05:36:19.441122429 +0000 UTC m=+22.850781378"
Aug 05 05:36:19.455811 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.455773    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9pgbw" podStartSLOduration=6.455762279 podStartE2EDuration="6.455762279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:19.455451729 +0000 UTC m=+22.865110677" watchObservedRunningTime="2026-08-05 05:36:19.455762279 +0000 UTC m=+22.865421224"
Aug 05 05:36:19.468461 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.468425    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hcrkv" podStartSLOduration=7.108519835 podStartE2EDuration="21.46841259s" totalImagesPullingTime="14.359892755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:19.468118578 +0000 UTC m=+22.877777522" watchObservedRunningTime="2026-08-05 05:36:19.46841259 +0000 UTC m=+22.878071528"
Aug 05 05:36:19.483836 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:19.483802    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sx8xw" podStartSLOduration=3.01271352 podStartE2EDuration="21.483790289s" totalImagesPullingTime="18.471076769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:19.483333515 +0000 UTC m=+22.892992457" watchObservedRunningTime="2026-08-05 05:36:19.483790289 +0000 UTC m=+22.893449234"
Aug 05 05:36:20.342061 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.342041    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 05:36:20.442900 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.442830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4" event={"ID":"686ee3ba-037b-4324-86c0-7c46e4c4fc31","Type":"ContainerStarted","Data":"30de86b680721873cbfcdb5e1403c2a71f53a0b8060f0397e2fb88b8bf67fab9"}
Aug 05 05:36:20.444334 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.444303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ntns" event={"ID":"805c01e7-c721-410e-a13a-09bd4987a46c","Type":"ContainerStarted","Data":"612c6f2971b85fc290e115afbe8dd93d18939e6d949818a8318595019d8686fa"}
Aug 05 05:36:20.447835 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.447803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"9784d772be19dc1a53320d8bdc02c4f51e8442ed05eb351a7a14b548c132698a"}
Aug 05 05:36:20.470993 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.470932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5brmv" podStartSLOduration=4.005871523 podStartE2EDuration="22.470917954s" totalImagesPullingTime="18.465046431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:19.513246264 +0000 UTC m=+22.922905208" watchObservedRunningTime="2026-08-05 05:36:20.470917954 +0000 UTC m=+23.880576902"
Aug 05 05:36:20.471381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:20.471353    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9ntns" podStartSLOduration=4.015253935 podStartE2EDuration="22.471342657s" totalImagesPullingTime="18.456088722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:20.470475703 +0000 UTC m=+23.880134650" watchObservedRunningTime="2026-08-05 05:36:20.471342657 +0000 UTC m=+23.881001608"
Aug 05 05:36:21.218107 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.218009    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T05:36:20.342057233Z","UUID":"064391b0-cc01-4005-9190-7370c32ddfe1","Handler":null,"Name":"","Endpoint":""}
Aug 05 05:36:21.219532 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.219510    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 05:36:21.219671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.219549    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 05:36:21.236184 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.236157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:21.236303 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.236157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:21.236303 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:21.236261    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:21.236417 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:21.236353    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:21.236417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.236156    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:21.236524 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:21.236446    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:21.919325 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.919027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:36:21.919756 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:21.919618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:36:22.454791 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:22.454752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"9a8cf09b838f3d948e9985d5208915630b1a9ef02238f4cfff77fec9bb74328b"}
Aug 05 05:36:22.457002 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:22.456973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4" event={"ID":"686ee3ba-037b-4324-86c0-7c46e4c4fc31","Type":"ContainerStarted","Data":"34c41960f1076f60d936ad2ed82f3e5d31d43faf4c242b880e9fe2d81bccb6bb"}
Aug 05 05:36:22.457300 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:22.457257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:36:22.457784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:22.457764    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hcrkv"
Aug 05 05:36:22.476557 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:22.476516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gxm4" podStartSLOduration=3.643009298 podStartE2EDuration="24.476504637s" totalImagesPullingTime="20.833495339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:22.476133262 +0000 UTC m=+25.885792210" watchObservedRunningTime="2026-08-05 05:36:22.476504637 +0000 UTC m=+25.886163584"
Aug 05 05:36:23.236218 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:23.236181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:23.236761 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:23.236314    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:23.236761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:23.236425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:23.236761 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:23.236547    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:23.236761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:23.236609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:23.236761 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:23.236688    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:24.464612 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.464401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" event={"ID":"b994f761-fea3-41b7-a35d-79a4fbc40cc0","Type":"ContainerStarted","Data":"a5eab45fc1ac516c2f599058f6796640f73b489ca39ac88ca67ebfbd03136747"}
Aug 05 05:36:24.465431 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.464669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:36:24.466231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.466207    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="dcc9505d3b8b0cd046e923427779c3390a8b7a3680912ef9540cb834e95c18a1" exitCode=0
Aug 05 05:36:24.466358 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.466290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"dcc9505d3b8b0cd046e923427779c3390a8b7a3680912ef9540cb834e95c18a1"}
Aug 05 05:36:24.482258 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.482239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:36:24.494440 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:24.494393    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6" podStartSLOduration=7.961874507 podStartE2EDuration="26.494381548s" totalImagesPullingTime="18.532507041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:24.494004578 +0000 UTC m=+27.903663526" watchObservedRunningTime="2026-08-05 05:36:24.494381548 +0000 UTC m=+27.904040497"
Aug 05 05:36:25.236373 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.236174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:25.236373 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.236177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:25.236373 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:25.236331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:25.236663 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:25.236395    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:25.236663 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.236473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:25.236663 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:25.236560    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:25.468434 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.468408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:36:25.468802 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.468474    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:36:25.483043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:25.483018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:36:26.224418 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.224388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9cdl2"]
Aug 05 05:36:26.224617 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.224524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:26.224665 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:26.224618    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:26.231108 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.231074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdw26"]
Aug 05 05:36:26.231240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.231189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:26.231314 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:26.231292    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:26.231740 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.231714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47xz4"]
Aug 05 05:36:26.231847 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.231831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:26.231929 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:26.231911    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:26.472835 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.472803    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="259e94af0646e9a8d71a21ab564ec4bd1f47bc1229af38fb7ffdf5d90b94f5e3" exitCode=0
Aug 05 05:36:26.473235 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:26.472886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"259e94af0646e9a8d71a21ab564ec4bd1f47bc1229af38fb7ffdf5d90b94f5e3"}
Aug 05 05:36:28.236270 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:28.236242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:28.236629 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:28.236339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:28.236629 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:28.236343    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:28.236629 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:28.236366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:28.236629 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:28.236441    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:28.236629 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:28.236504    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:28.479085 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:28.479056    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="3c8360213026f1b01122e44341c641aceb757417a32bd9a60f50bf4317040e95" exitCode=0
Aug 05 05:36:28.479239 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:28.479098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"3c8360213026f1b01122e44341c641aceb757417a32bd9a60f50bf4317040e95"}
Aug 05 05:36:30.235698 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.235660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:30.236278 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.235702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:30.236278 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.235702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:30.236278 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.235787    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:30.236278 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.235882    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:30.236278 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.235938    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:30.758525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.758481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.758539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758659    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758664    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758687    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758699    2581 projected.go:196] Error preparing data for projected volume kube-api-access-6d4fr for pod openshift-network-diagnostics/network-check-target-fdw26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:30.758732 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758726    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:02.758707778 +0000 UTC m=+66.168366718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 05:36:30.759037 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.758742    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr podName:9eab6a52-c405-459b-9e7f-69fd9b6095ba nodeName:}" failed. No retries permitted until 2026-08-05 05:37:02.758734083 +0000 UTC m=+66.168393011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6d4fr" (UniqueName: "kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr") pod "network-check-target-fdw26" (UID: "9eab6a52-c405-459b-9e7f-69fd9b6095ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 05:36:30.859542 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:30.859507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:30.859704 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.859648    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:30.859749 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:30.859714    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret podName:3fc3f4c8-4d7f-4b98-b181-1cac250ce75d nodeName:}" failed. No retries permitted until 2026-08-05 05:37:02.859694013 +0000 UTC m=+66.269352950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret") pod "global-pull-secret-syncer-9cdl2" (UID: "3fc3f4c8-4d7f-4b98-b181-1cac250ce75d") : object "kube-system"/"original-pull-secret" not registered
Aug 05 05:36:32.235912 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.235875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:32.235912 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.235915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:32.236560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.235926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:32.236560 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.236027    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:36:32.236560 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.236165    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdw26" podUID="9eab6a52-c405-459b-9e7f-69fd9b6095ba"
Aug 05 05:36:32.236560 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.236249    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9cdl2" podUID="3fc3f4c8-4d7f-4b98-b181-1cac250ce75d"
Aug 05 05:36:32.384704 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.384677    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeReady"
Aug 05 05:36:32.384861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.384831    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 05:36:32.419491 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.419461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5898857596-qbpg4"]
Aug 05 05:36:32.421833 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.421807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.422194 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.422170    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"]
Aug 05 05:36:32.423767 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.423742    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 05:36:32.423985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.423967    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwrzk\""
Aug 05 05:36:32.424088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.424030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 05:36:32.424088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.424071    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 05:36:32.424418 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.424402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.426253 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.426225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 05 05:36:32.426367 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.426306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 05 05:36:32.426606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.426578    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vszjg\""
Aug 05 05:36:32.429485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.429464    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 05:36:32.436485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.436465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-htl9b"]
Aug 05 05:36:32.442605 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.442575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"]
Aug 05 05:36:32.442701 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.442635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5898857596-qbpg4"]
Aug 05 05:36:32.442760 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.442713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.444754 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.444732    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 05:36:32.444856 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.444812    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 05:36:32.445158 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.445139    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n4b52\""
Aug 05 05:36:32.446007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.445988    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vtk9x"]
Aug 05 05:36:32.447780 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.447764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.450219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.450202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 05:36:32.450348 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.450326    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 05:36:32.450444 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.450426    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4t8ws\""
Aug 05 05:36:32.450701 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.450687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 05:36:32.455087 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.455062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htl9b"]
Aug 05 05:36:32.458294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.458272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtk9x"]
Aug 05 05:36:32.572708 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz78c\" (UniqueName: \"kubernetes.io/projected/14dfc461-68c5-42bd-b52e-77089576ba07-kube-api-access-hz78c\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.572708 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d88b81-cd88-450d-b900-fa18ac50a693-config-volume\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a98b470c-b616-42e8-9672-bac000436b06-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hm65\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.572902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14dfc461-68c5-42bd-b52e-77089576ba07-cert\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.572966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.573009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nwrx\" (UniqueName: \"kubernetes.io/projected/40d88b81-cd88-450d-b900-fa18ac50a693-kube-api-access-7nwrx\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.573045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.573140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.573171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d88b81-cd88-450d-b900-fa18ac50a693-tmp-dir\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.573282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.573226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.664091 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.664048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:32.673862 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.673836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d88b81-cd88-450d-b900-fa18ac50a693-config-volume\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.674012 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.673877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674012 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.673896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a98b470c-b616-42e8-9672-bac000436b06-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.674012 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.673916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.674012 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.673939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674195 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674072    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:32.674195 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674142    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:33.174121782 +0000 UTC m=+36.583780729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:32.674195 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hm65\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14dfc461-68c5-42bd-b52e-77089576ba07-cert\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674361 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nwrx\" (UniqueName: \"kubernetes.io/projected/40d88b81-cd88-450d-b900-fa18ac50a693-kube-api-access-7nwrx\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d88b81-cd88-450d-b900-fa18ac50a693-tmp-dir\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz78c\" (UniqueName: \"kubernetes.io/projected/14dfc461-68c5-42bd-b52e-77089576ba07-kube-api-access-hz78c\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40d88b81-cd88-450d-b900-fa18ac50a693-config-volume\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.674657 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674656    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674718    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:33.174700009 +0000 UTC m=+36.584358939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674785    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674796    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a98b470c-b616-42e8-9672-bac000436b06-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:32.674831    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:33.174819561 +0000 UTC m=+36.584478490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d88b81-cd88-450d-b900-fa18ac50a693-tmp-dir\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.675199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.674962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.678442 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.678415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.678523 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.678465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.678646 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.678631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14dfc461-68c5-42bd-b52e-77089576ba07-cert\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.685341 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.685172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hm65\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.685341 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.685291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz78c\" (UniqueName: \"kubernetes.io/projected/14dfc461-68c5-42bd-b52e-77089576ba07-kube-api-access-hz78c\") pod \"ingress-canary-vtk9x\" (UID: \"14dfc461-68c5-42bd-b52e-77089576ba07\") " pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.685560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.685383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:32.685560 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.685473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nwrx\" (UniqueName: \"kubernetes.io/projected/40d88b81-cd88-450d-b900-fa18ac50a693-kube-api-access-7nwrx\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:32.743556 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.743527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:32.760548 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.760530    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtk9x"
Aug 05 05:36:32.798871 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.798838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:32.890835 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:32.890805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtk9x"]
Aug 05 05:36:32.925801 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:36:32.925779    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dfc461_68c5_42bd_b52e_77089576ba07.slice/crio-352d4824edebe1ba0e08328c18670b170e254d427001d2395ef292e34ca2d2e6 WatchSource:0}: Error finding container 352d4824edebe1ba0e08328c18670b170e254d427001d2395ef292e34ca2d2e6: Status 404 returned error can't find the container with id 352d4824edebe1ba0e08328c18670b170e254d427001d2395ef292e34ca2d2e6
Aug 05 05:36:33.177832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.177738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:33.177832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.177784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.177841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.177892    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.177975    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.177979    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:34.177961414 +0000 UTC m=+37.587620352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.177976    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.178051    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:33.178085 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.178036    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:34.178021812 +0000 UTC m=+37.587680752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:33.178357 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:33.178095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:34.178084247 +0000 UTC m=+37.587743173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:33.490147 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.490116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtk9x" event={"ID":"14dfc461-68c5-42bd-b52e-77089576ba07","Type":"ContainerStarted","Data":"352d4824edebe1ba0e08328c18670b170e254d427001d2395ef292e34ca2d2e6"}
Aug 05 05:36:33.492663 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.492641    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="33d9b2aa0ef17af60905b2765932f352c84e52da1cf3d89e2c4ec7d796e6b18e" exitCode=0
Aug 05 05:36:33.492753 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:33.492668    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"33d9b2aa0ef17af60905b2765932f352c84e52da1cf3d89e2c4ec7d796e6b18e"}
Aug 05 05:36:34.184939 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.184891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:34.184939 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.184955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:34.185177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.185020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:34.185177 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185058    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:34.185177 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185124    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:34.185177 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185134    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:36.185112449 +0000 UTC m=+39.594771377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:34.185177 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185141    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:34.185382 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185126    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:34.185382 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185195    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:36.185178388 +0000 UTC m=+39.594837330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:34.185382 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:34.185263    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:36.18524344 +0000 UTC m=+39.594902367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:34.236309 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.236282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:36:34.236458 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.236391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:36:34.236458 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.236420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:36:34.239153 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239129    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jmhv\""
Aug 05 05:36:34.239281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fpxxn\""
Aug 05 05:36:34.239627 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 05:36:34.239852 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 05:36:34.239852 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 05:36:34.240033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.239982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 05:36:34.499552 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.499516    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd276d1c-739b-441a-862c-d8e0f9931d69" containerID="125cf55e1ad9683a4136dfd75467b31a07b9826aead56dae802af179e304f668" exitCode=0
Aug 05 05:36:34.499994 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:34.499552    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerDied","Data":"125cf55e1ad9683a4136dfd75467b31a07b9826aead56dae802af179e304f668"}
Aug 05 05:36:35.504992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:35.504962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htts4" event={"ID":"cd276d1c-739b-441a-862c-d8e0f9931d69","Type":"ContainerStarted","Data":"94c8c6b8c38ab644ec215a50ce1edd5d29fb74bab8714c71f6392fcdc8bd956b"}
Aug 05 05:36:35.530796 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:35.530755    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htts4" podStartSLOduration=7.990002584 podStartE2EDuration="37.530740253s" totalImagesPullingTime="29.540737669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:35.529260321 +0000 UTC m=+38.938919285" watchObservedRunningTime="2026-08-05 05:36:35.530740253 +0000 UTC m=+38.940399219"
Aug 05 05:36:35.653396 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:35.653363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:35.719173 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:35.719143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:36.202150 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.202064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:36.202150 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.202107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:36.202318 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.202185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:36.202318 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202225    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:36.202318 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202283    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:36.202318 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202302    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:36.202318 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202303    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:36.202464 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202291    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:40.202271613 +0000 UTC m=+43.611930548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:36.202464 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202377    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:40.202364209 +0000 UTC m=+43.612023134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:36.202464 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:36.202389    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:40.20238223 +0000 UTC m=+43.612041156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:36.463546 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.463456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:36.508267 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.508236    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtk9x" event={"ID":"14dfc461-68c5-42bd-b52e-77089576ba07","Type":"ContainerStarted","Data":"73c19908e40fb59d4c5b245df1427321252d25e298510cfcdae2b0f83df38ccb"}
Aug 05 05:36:36.525126 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.525078    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vtk9x" podStartSLOduration=1.611077332 podStartE2EDuration="4.525065681s" totalImagesPullingTime="2.913988349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:36:36.524086188 +0000 UTC m=+39.933745137" watchObservedRunningTime="2026-08-05 05:36:36.525065681 +0000 UTC m=+39.934724629"
Aug 05 05:36:36.528743 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:36.528714    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:37.516921 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:37.516888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:37.568773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:37.568740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:38.466985 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:38.466932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:38.533834 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:38.533806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:40.233517 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:40.233476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233613    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:40.233659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233680    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:48.233658584 +0000 UTC m=+51.643317509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:40.233710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233727    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233764    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:48.233753298 +0000 UTC m=+51.643412225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233809    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233821    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:40.233915 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:40.233860    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:36:48.23384754 +0000 UTC m=+51.643506484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:40.434125 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:40.434095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log" limit=1024
Aug 05 05:36:48.292731 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:48.292693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:48.292759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:48.292779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292839    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292870    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292880    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292907    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:04.292889936 +0000 UTC m=+67.702548861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292940    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:04.292932352 +0000 UTC m=+67.702591278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292921    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:36:48.293213 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:36:48.292984    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:04.292973044 +0000 UTC m=+67.702631983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:36:57.488576 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:36:57.488547    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26cn6"
Aug 05 05:37:02.794578 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.794528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:37:02.795016 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.794753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:37:02.797221 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.797203    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 05:37:02.797281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.797254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 05:37:02.805006 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:02.804987    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 05:37:02.805075 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:02.805054    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:06.805035356 +0000 UTC m=+130.214694284 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : secret "metrics-daemon-secret" not found
Aug 05 05:37:02.806983 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.806966    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 05:37:02.819253 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.819225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d4fr\" (UniqueName: \"kubernetes.io/projected/9eab6a52-c405-459b-9e7f-69fd9b6095ba-kube-api-access-6d4fr\") pod \"network-check-target-fdw26\" (UID: \"9eab6a52-c405-459b-9e7f-69fd9b6095ba\") " pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:37:02.895471 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.895421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:37:02.898197 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.898177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 05:37:02.908106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:02.908087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fc3f4c8-4d7f-4b98-b181-1cac250ce75d-original-pull-secret\") pod \"global-pull-secret-syncer-9cdl2\" (UID: \"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d\") " pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:37:03.048178 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.048073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9cdl2"
Aug 05 05:37:03.063842 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.063817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fpxxn\""
Aug 05 05:37:03.071652 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.071628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:37:03.200209 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.200179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9cdl2"]
Aug 05 05:37:03.203197 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:37:03.203172    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc3f4c8_4d7f_4b98_b181_1cac250ce75d.slice/crio-496c5ef3160c434cf25e1b8cfeca3faf1f4c8f3c6167577709cd792f00744706 WatchSource:0}: Error finding container 496c5ef3160c434cf25e1b8cfeca3faf1f4c8f3c6167577709cd792f00744706: Status 404 returned error can't find the container with id 496c5ef3160c434cf25e1b8cfeca3faf1f4c8f3c6167577709cd792f00744706
Aug 05 05:37:03.217846 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.217824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdw26"]
Aug 05 05:37:03.220609 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:37:03.220584    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eab6a52_c405_459b_9e7f_69fd9b6095ba.slice/crio-3701063c78ea7448b0bc9b07fe92da3222b17c19f2a66abfe6c4df5e026e7b3d WatchSource:0}: Error finding container 3701063c78ea7448b0bc9b07fe92da3222b17c19f2a66abfe6c4df5e026e7b3d: Status 404 returned error can't find the container with id 3701063c78ea7448b0bc9b07fe92da3222b17c19f2a66abfe6c4df5e026e7b3d
Aug 05 05:37:03.571430 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.571395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdw26" event={"ID":"9eab6a52-c405-459b-9e7f-69fd9b6095ba","Type":"ContainerStarted","Data":"3701063c78ea7448b0bc9b07fe92da3222b17c19f2a66abfe6c4df5e026e7b3d"}
Aug 05 05:37:03.572329 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:03.572308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9cdl2" event={"ID":"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d","Type":"ContainerStarted","Data":"496c5ef3160c434cf25e1b8cfeca3faf1f4c8f3c6167577709cd792f00744706"}
Aug 05 05:37:04.309658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:04.309441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:37:04.309658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:04.309538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:37:04.309658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:04.309569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:37:04.309658 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.309579    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:37:04.309658 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.309662    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:36.309639999 +0000 UTC m=+99.719298926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:37:04.310331 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.309682    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:37:04.310331 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.309730    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:36.309717694 +0000 UTC m=+99.719376626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:37:04.310443 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.310362    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:37:04.310443 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.310378    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:37:04.310443 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:04.310431    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:37:36.310414947 +0000 UTC m=+99.720073885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:37:05.203883 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.203774    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"]
Aug 05 05:37:05.229376 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.229347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"]
Aug 05 05:37:05.229541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.229463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.232151 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.232114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 05 05:37:05.233166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.232984    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 05 05:37:05.233166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.233024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 05 05:37:05.233876 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.233853    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 05 05:37:05.316983 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.316940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqhh\" (UniqueName: \"kubernetes.io/projected/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-kube-api-access-gbqhh\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.317355 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.317011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-tmp\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.317355 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.317074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.418031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.417802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.418031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.417883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqhh\" (UniqueName: \"kubernetes.io/projected/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-kube-api-access-gbqhh\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.418031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.417935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-tmp\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.418403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.418377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-tmp\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.421480 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.421428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.426862 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.426821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqhh\" (UniqueName: \"kubernetes.io/projected/db297c3f-6d17-41b4-94a1-da53e0ae0fd9-kube-api-access-gbqhh\") pod \"klusterlet-addon-workmgr-7c4dd689f7-rp7jf\" (UID: \"db297c3f-6d17-41b4-94a1-da53e0ae0fd9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.542874 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.542833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:05.713683 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:05.713605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"]
Aug 05 05:37:05.718192 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:37:05.718154    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb297c3f_6d17_41b4_94a1_da53e0ae0fd9.slice/crio-389e1042f74906c24077463b1beea3750e2b6af15cfd7a03177149eb44bc081d WatchSource:0}: Error finding container 389e1042f74906c24077463b1beea3750e2b6af15cfd7a03177149eb44bc081d: Status 404 returned error can't find the container with id 389e1042f74906c24077463b1beea3750e2b6af15cfd7a03177149eb44bc081d
Aug 05 05:37:06.582278 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:06.582245    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" event={"ID":"db297c3f-6d17-41b4-94a1-da53e0ae0fd9","Type":"ContainerStarted","Data":"389e1042f74906c24077463b1beea3750e2b6af15cfd7a03177149eb44bc081d"}
Aug 05 05:37:08.591128 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:08.591085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdw26" event={"ID":"9eab6a52-c405-459b-9e7f-69fd9b6095ba","Type":"ContainerStarted","Data":"39e01dea3f5020d562727fe64a3b1c717f5b6bf58facdb23e973f990cd961f0e"}
Aug 05 05:37:08.591781 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:08.591759    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:37:08.593453 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:08.593401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9cdl2" event={"ID":"3fc3f4c8-4d7f-4b98-b181-1cac250ce75d","Type":"ContainerStarted","Data":"663ab27d2733aac746b0f2926c439fff91e6e04227ea486c4bcaa9d7238f2a06"}
Aug 05 05:37:08.609660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:08.609604    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fdw26" podStartSLOduration=65.399056517 podStartE2EDuration="1m10.609585764s" totalImagesPullingTime="5.210529247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:37:08.607763885 +0000 UTC m=+72.017422855" watchObservedRunningTime="2026-08-05 05:37:08.609585764 +0000 UTC m=+72.019244713"
Aug 05 05:37:08.623906 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:08.623862    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9cdl2" podStartSLOduration=65.392526409 podStartE2EDuration="1m10.623848093s" totalImagesPullingTime="5.231321684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:37:08.62309217 +0000 UTC m=+72.032751119" watchObservedRunningTime="2026-08-05 05:37:08.623848093 +0000 UTC m=+72.033507041"
Aug 05 05:37:11.602177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:11.602137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" event={"ID":"db297c3f-6d17-41b4-94a1-da53e0ae0fd9","Type":"ContainerStarted","Data":"caf08f0aa6b28e81ddfeb2a91a8f668c42a6cf92e18cb5d2b5d13ff8ed72a1c1"}
Aug 05 05:37:11.602611 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:11.602353    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:11.604088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:11.604059    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:37:11.619842 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:11.619798    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" podStartSLOduration=1.359008358 podStartE2EDuration="6.619783999s" totalImagesPullingTime="5.260775641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:37:11.618852962 +0000 UTC m=+75.028511911" watchObservedRunningTime="2026-08-05 05:37:11.619783999 +0000 UTC m=+75.029442946"
Aug 05 05:37:36.340127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:36.340073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:37:36.340127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:36.340129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:36.340164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340246    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340247    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340286    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340298    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:40.340284512 +0000 UTC m=+163.749943438 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340304    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340325    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:40.340305049 +0000 UTC m=+163.749963986 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:37:36.340597 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:37:36.340352    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:40.340340104 +0000 UTC m=+163.749999051 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:37:40.600658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:37:40.600627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fdw26"
Aug 05 05:38:06.855322 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:06.855275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:38:06.855902 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:06.855444    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 05:38:06.855902 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:06.855544    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs podName:8d5d27ff-1728-4820-a619-935ef6094cd9 nodeName:}" failed. No retries permitted until 2026-08-05 05:40:08.855521631 +0000 UTC m=+252.265180557 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs") pod "network-metrics-daemon-47xz4" (UID: "8d5d27ff-1728-4820-a619-935ef6094cd9") : secret "metrics-daemon-secret" not found
Aug 05 05:38:35.435547 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:35.435493    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5898857596-qbpg4" podUID="a35f6396-abdb-42b6-837f-e9cae3bef2b7"
Aug 05 05:38:35.443654 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:35.443625    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2" podUID="a98b470c-b616-42e8-9672-bac000436b06"
Aug 05 05:38:35.453791 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:35.453761    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htl9b" podUID="40d88b81-cd88-450d-b900-fa18ac50a693"
Aug 05 05:38:35.795841 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:35.795814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:38:35.796008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:35.795813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:38:35.796008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:35.795815    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:38:37.246664 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.246637    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"]
Aug 05 05:38:37.248752 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.248735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.254460 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:37.254399    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-47xz4" podUID="8d5d27ff-1728-4820-a619-935ef6094cd9"
Aug 05 05:38:37.256524 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.256509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 05 05:38:37.257703 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.257688    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 05 05:38:37.258184 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.258172    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 05 05:38:37.258901 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.258887    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l62f8\""
Aug 05 05:38:37.258936 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.258889    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 05 05:38:37.271238 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.271214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"]
Aug 05 05:38:37.353992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.353963    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-fffdc8c78-5j4zb"]
Aug 05 05:38:37.355776 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.355761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.358250 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358229    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 05 05:38:37.358250 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358248    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 05 05:38:37.358618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 05 05:38:37.358618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358616    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 05:38:37.358839 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358827    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 05:38:37.358884 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.358854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 05 05:38:37.359015 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.359003    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vgk5j\""
Aug 05 05:38:37.372010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.371988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae5b21c-f10b-4f75-bc55-370509f0c111-serving-cert\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.372105 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.372012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bae5b21c-f10b-4f75-bc55-370509f0c111-config\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.372105 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.372055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995zs\" (UniqueName: \"kubernetes.io/projected/bae5b21c-f10b-4f75-bc55-370509f0c111-kube-api-access-995zs\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.376669 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.376645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fffdc8c78-5j4zb"]
Aug 05 05:38:37.445299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.445272    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"]
Aug 05 05:38:37.447019 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.447005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"
Aug 05 05:38:37.448984 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.448960    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tgwcl\""
Aug 05 05:38:37.455274 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.455242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"]
Aug 05 05:38:37.472795 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.472911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae5b21c-f10b-4f75-bc55-370509f0c111-serving-cert\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.472911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995zs\" (UniqueName: \"kubernetes.io/projected/bae5b21c-f10b-4f75-bc55-370509f0c111-kube-api-access-995zs\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.472911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4lxh\" (UniqueName: \"kubernetes.io/projected/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-kube-api-access-h4lxh\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.472911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-stats-auth\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.473125 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-default-certificate\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.473125 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.472968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.473125 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.473014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bae5b21c-f10b-4f75-bc55-370509f0c111-config\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.473467 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.473450    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bae5b21c-f10b-4f75-bc55-370509f0c111-config\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.474893 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.474872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae5b21c-f10b-4f75-bc55-370509f0c111-serving-cert\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.484175 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.484148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995zs\" (UniqueName: \"kubernetes.io/projected/bae5b21c-f10b-4f75-bc55-370509f0c111-kube-api-access-995zs\") pod \"service-ca-operator-784f97bcf6-pxxvp\" (UID: \"bae5b21c-f10b-4f75-bc55-370509f0c111\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.551802 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.551726    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-x2dgc"]
Aug 05 05:38:37.553792 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.553773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.556155 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.556134    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 05:38:37.556298 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.556284    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"
Aug 05 05:38:37.556413 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.556399    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 05 05:38:37.556458 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.556393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 05:38:37.557077 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.557053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 05 05:38:37.558083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.557222    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7c8dx\""
Aug 05 05:38:37.566106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.565906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-x2dgc"]
Aug 05 05:38:37.566695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.566676    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 05 05:38:37.573554 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.573665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4lxh\" (UniqueName: \"kubernetes.io/projected/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-kube-api-access-h4lxh\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.573665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-stats-auth\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.573777 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-default-certificate\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.573777 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.573777 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.573749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45lk\" (UniqueName: \"kubernetes.io/projected/bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c-kube-api-access-j45lk\") pod \"network-check-source-65bdbbff45-7fxm9\" (UID: \"bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"
Aug 05 05:38:37.573777 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:37.573689    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 05:38:37.573969 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:37.573828    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:38.07380738 +0000 UTC m=+161.483466319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : secret "router-metrics-certs-default" not found
Aug 05 05:38:37.574038 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:37.574001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:38.073980501 +0000 UTC m=+161.483639452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : configmap references non-existent config key: service-ca.crt
Aug 05 05:38:37.576099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.576082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-stats-auth\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.576172 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.576126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-default-certificate\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.588201 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.588183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4lxh\" (UniqueName: \"kubernetes.io/projected/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-kube-api-access-h4lxh\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:37.674676 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-snapshots\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.674861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a57edde-4f0e-4e0f-af84-55647db789bc-serving-cert\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.674861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-tmp\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.674861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kn2d\" (UniqueName: \"kubernetes.io/projected/7a57edde-4f0e-4e0f-af84-55647db789bc-kube-api-access-2kn2d\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.675061 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45lk\" (UniqueName: \"kubernetes.io/projected/bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c-kube-api-access-j45lk\") pod \"network-check-source-65bdbbff45-7fxm9\" (UID: \"bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"
Aug 05 05:38:37.675061 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.674987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-service-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.675061 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.675013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.682512 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.682492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45lk\" (UniqueName: \"kubernetes.io/projected/bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c-kube-api-access-j45lk\") pod \"network-check-source-65bdbbff45-7fxm9\" (UID: \"bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"
Aug 05 05:38:37.691154 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.691130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp"]
Aug 05 05:38:37.693815 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:37.693795    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae5b21c_f10b_4f75_bc55_370509f0c111.slice/crio-9c9a309fa0a65465c6e5914f3d89cdfea220486c3801d2398b8be22aab9d99a4 WatchSource:0}: Error finding container 9c9a309fa0a65465c6e5914f3d89cdfea220486c3801d2398b8be22aab9d99a4: Status 404 returned error can't find the container with id 9c9a309fa0a65465c6e5914f3d89cdfea220486c3801d2398b8be22aab9d99a4
Aug 05 05:38:37.755066 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.755038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"
Aug 05 05:38:37.775834 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.775808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-service-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.775857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.775905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-snapshots\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.775968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a57edde-4f0e-4e0f-af84-55647db789bc-serving-cert\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776154 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.776007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-tmp\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776154 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.776033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kn2d\" (UniqueName: \"kubernetes.io/projected/7a57edde-4f0e-4e0f-af84-55647db789bc-kube-api-access-2kn2d\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776599 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.776550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-service-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776697 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.776622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-tmp\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.776697 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.776688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7a57edde-4f0e-4e0f-af84-55647db789bc-snapshots\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.777228 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.777202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a57edde-4f0e-4e0f-af84-55647db789bc-trusted-ca-bundle\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.778355 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.778340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a57edde-4f0e-4e0f-af84-55647db789bc-serving-cert\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.783941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.783905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kn2d\" (UniqueName: \"kubernetes.io/projected/7a57edde-4f0e-4e0f-af84-55647db789bc-kube-api-access-2kn2d\") pod \"insights-operator-77696685b-x2dgc\" (UID: \"7a57edde-4f0e-4e0f-af84-55647db789bc\") " pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.803392 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.803330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp" event={"ID":"bae5b21c-f10b-4f75-bc55-370509f0c111","Type":"ContainerStarted","Data":"9c9a309fa0a65465c6e5914f3d89cdfea220486c3801d2398b8be22aab9d99a4"}
Aug 05 05:38:37.868366 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.868334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-x2dgc"
Aug 05 05:38:37.871897 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.871781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9"]
Aug 05 05:38:37.875449 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:37.875420    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbb58c5_ab6e_4548_bedd_d0b6053d4e0c.slice/crio-c28c7ac115580ceea9c9823d3de014782e9e0a9b423c4b3c9660a9b26323d10f WatchSource:0}: Error finding container c28c7ac115580ceea9c9823d3de014782e9e0a9b423c4b3c9660a9b26323d10f: Status 404 returned error can't find the container with id c28c7ac115580ceea9c9823d3de014782e9e0a9b423c4b3c9660a9b26323d10f
Aug 05 05:38:37.993453 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:37.993328    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-x2dgc"]
Aug 05 05:38:37.995816 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:37.995777    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a57edde_4f0e_4e0f_af84_55647db789bc.slice/crio-7a73216edd32faa6760f64977712b87a54436bd2836691d9e0d71f8ef889484d WatchSource:0}: Error finding container 7a73216edd32faa6760f64977712b87a54436bd2836691d9e0d71f8ef889484d: Status 404 returned error can't find the container with id 7a73216edd32faa6760f64977712b87a54436bd2836691d9e0d71f8ef889484d
Aug 05 05:38:38.078099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.078013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:38.078252 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.078174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:38.078306 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:38.078251    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:39.078235732 +0000 UTC m=+162.487894663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : configmap references non-existent config key: service-ca.crt
Aug 05 05:38:38.078306 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:38.078294    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 05:38:38.078417 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:38.078347    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:39.078328063 +0000 UTC m=+162.487986989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : secret "router-metrics-certs-default" not found
Aug 05 05:38:38.808605 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.808431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9" event={"ID":"bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c","Type":"ContainerStarted","Data":"8eed5756d023cf8a5546232e8386328c1b5e6e11373733c97bc53a71e5ddb986"}
Aug 05 05:38:38.808605 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.808490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9" event={"ID":"bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c","Type":"ContainerStarted","Data":"c28c7ac115580ceea9c9823d3de014782e9e0a9b423c4b3c9660a9b26323d10f"}
Aug 05 05:38:38.809618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.809551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-x2dgc" event={"ID":"7a57edde-4f0e-4e0f-af84-55647db789bc","Type":"ContainerStarted","Data":"7a73216edd32faa6760f64977712b87a54436bd2836691d9e0d71f8ef889484d"}
Aug 05 05:38:38.829999 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:38.829808    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7fxm9" podStartSLOduration=1.829787879 podStartE2EDuration="1.829787879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:38:38.828366854 +0000 UTC m=+162.238025801" watchObservedRunningTime="2026-08-05 05:38:38.829787879 +0000 UTC m=+162.239446827"
Aug 05 05:38:39.088083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:39.087987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:39.088083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:39.088080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:39.088313 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:39.088153    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 05:38:39.088313 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:39.088203    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:41.088183873 +0000 UTC m=+164.497842806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : configmap references non-existent config key: service-ca.crt
Aug 05 05:38:39.088313 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:39.088221    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:41.088212525 +0000 UTC m=+164.497871452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : secret "router-metrics-certs-default" not found
Aug 05 05:38:40.399815 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.399793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.399846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.399870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") pod \"image-registry-5898857596-qbpg4\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") " pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.399985    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.399985    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.400059    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.400082    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5898857596-qbpg4: secret "image-registry-tls" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.400039    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls podName:40d88b81-cd88-450d-b900-fa18ac50a693 nodeName:}" failed. No retries permitted until 2026-08-05 05:40:42.400026294 +0000 UTC m=+285.809685220 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls") pod "dns-default-htl9b" (UID: "40d88b81-cd88-450d-b900-fa18ac50a693") : secret "dns-default-metrics-tls" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.400125    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert podName:a98b470c-b616-42e8-9672-bac000436b06 nodeName:}" failed. No retries permitted until 2026-08-05 05:40:42.400116576 +0000 UTC m=+285.809775501 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-bz9x2" (UID: "a98b470c-b616-42e8-9672-bac000436b06") : secret "networking-console-plugin-cert" not found
Aug 05 05:38:40.400185 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:40.400137    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls podName:a35f6396-abdb-42b6-837f-e9cae3bef2b7 nodeName:}" failed. No retries permitted until 2026-08-05 05:40:42.400129735 +0000 UTC m=+285.809788661 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls") pod "image-registry-5898857596-qbpg4" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7") : secret "image-registry-tls" not found
Aug 05 05:38:40.821673 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.821632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp" event={"ID":"bae5b21c-f10b-4f75-bc55-370509f0c111","Type":"ContainerStarted","Data":"85233de5686a48d4ab98189b00538a47373b87001fa52950cc2559abb7ce82b3"}
Aug 05 05:38:40.823132 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.823105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-x2dgc" event={"ID":"7a57edde-4f0e-4e0f-af84-55647db789bc","Type":"ContainerStarted","Data":"e9f0fe454f122c0cd4bca5de856811a6c72d0643a66c93c86b9162ece9e085ea"}
Aug 05 05:38:40.839027 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.838988    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp" podStartSLOduration=1.140077779 podStartE2EDuration="3.83897494s" totalImagesPullingTime="2.698897161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:38:40.838394018 +0000 UTC m=+164.248052970" watchObservedRunningTime="2026-08-05 05:38:40.83897494 +0000 UTC m=+164.248633888"
Aug 05 05:38:40.855017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:40.854968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-x2dgc" podStartSLOduration=1.4600830089999999 podStartE2EDuration="3.8549379s" totalImagesPullingTime="2.394854891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:38:40.85347444 +0000 UTC m=+164.263133387" watchObservedRunningTime="2026-08-05 05:38:40.8549379 +0000 UTC m=+164.264596850"
Aug 05 05:38:41.106124 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:41.106033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:41.106286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:41.106129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:41.106286 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:41.106227    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:45.106204902 +0000 UTC m=+168.515863843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : configmap references non-existent config key: service-ca.crt
Aug 05 05:38:41.106286 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:41.106248    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 05:38:41.106427 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:41.106301    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:45.106283749 +0000 UTC m=+168.515942712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : secret "router-metrics-certs-default" not found
Aug 05 05:38:42.195722 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.195690    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6fm"]
Aug 05 05:38:42.197929 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.197911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.200451 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.200424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 05:38:42.200663 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.200647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q6jl7\""
Aug 05 05:38:42.200856 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.200844    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 05:38:42.211309 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.211285    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6fm"]
Aug 05 05:38:42.318056 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.318025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc321d6-1b0b-4b47-ab06-361771aa1257-data-volume\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.318056 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.318057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.318240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.318092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc321d6-1b0b-4b47-ab06-361771aa1257-crio-socket\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.318240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.318199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.318308 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.318246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85phh\" (UniqueName: \"kubernetes.io/projected/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-api-access-85phh\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85phh\" (UniqueName: \"kubernetes.io/projected/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-api-access-85phh\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc321d6-1b0b-4b47-ab06-361771aa1257-data-volume\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc321d6-1b0b-4b47-ab06-361771aa1257-crio-socket\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419893 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.419758    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 05:38:42.419893 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.419832    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:42.919810571 +0000 UTC m=+166.329469502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : configmap "kube-rbac-proxy" not found
Aug 05 05:38:42.419893 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.419838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebc321d6-1b0b-4b47-ab06-361771aa1257-crio-socket\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.419893 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.419845    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:42.420061 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.419904    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:42.919892225 +0000 UTC m=+166.329551155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:42.420061 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.420018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc321d6-1b0b-4b47-ab06-361771aa1257-data-volume\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.429484 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.429441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85phh\" (UniqueName: \"kubernetes.io/projected/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-api-access-85phh\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.924800 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.924758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.925027 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:42.924841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:42.925027 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.924902    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 05:38:42.925027 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.924910    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:42.925027 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.924972    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:43.924938931 +0000 UTC m=+167.334597856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : configmap "kube-rbac-proxy" not found
Aug 05 05:38:42.925027 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:42.924986    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:43.924980396 +0000 UTC m=+167.334639321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:43.932482 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.932441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:43.932932 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.932534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:43.932932 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:43.932561    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 05:38:43.932932 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:43.932619    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:45.932603137 +0000 UTC m=+169.342262062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : configmap "kube-rbac-proxy" not found
Aug 05 05:38:43.932932 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:43.932675    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:43.932932 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:43.932727    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:45.932714966 +0000 UTC m=+169.342373892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:43.933579 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.933557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6scdb"]
Aug 05 05:38:43.935571 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.935551    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:43.937800 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.937772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 05 05:38:43.937907 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.937820    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 05 05:38:43.938551 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.938530    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 05 05:38:43.938774 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.938756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9jqr6\""
Aug 05 05:38:43.938774 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.938764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 05 05:38:43.944900 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:43.944861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6scdb"]
Aug 05 05:38:44.033685 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.033649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-key\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.033854 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.033701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmzjp\" (UniqueName: \"kubernetes.io/projected/adb9b652-3f2c-4b3f-ae15-5015cb964973-kube-api-access-mmzjp\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.033854 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.033832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-cabundle\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.135193 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.135153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-cabundle\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.135367 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.135254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-key\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.135367 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.135299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmzjp\" (UniqueName: \"kubernetes.io/projected/adb9b652-3f2c-4b3f-ae15-5015cb964973-kube-api-access-mmzjp\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.136034 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.136011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-cabundle\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.137761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.137733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb9b652-3f2c-4b3f-ae15-5015cb964973-signing-key\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.143650 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.143626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmzjp\" (UniqueName: \"kubernetes.io/projected/adb9b652-3f2c-4b3f-ae15-5015cb964973-kube-api-access-mmzjp\") pod \"service-ca-98c88fbb5-6scdb\" (UID: \"adb9b652-3f2c-4b3f-ae15-5015cb964973\") " pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.248286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.248255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-6scdb"
Aug 05 05:38:44.366825 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.366768    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-6scdb"]
Aug 05 05:38:44.369611 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:44.369585    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb9b652_3f2c_4b3f_ae15_5015cb964973.slice/crio-ab387a58a97aa59360bc0274ba567796e026bcc62e07afef73932e515789c6aa WatchSource:0}: Error finding container ab387a58a97aa59360bc0274ba567796e026bcc62e07afef73932e515789c6aa: Status 404 returned error can't find the container with id ab387a58a97aa59360bc0274ba567796e026bcc62e07afef73932e515789c6aa
Aug 05 05:38:44.762959 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.762927    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9pgbw_4fc0f4e6-a22f-4087-a11a-dde36d4c22e6/dns-node-resolver/0.log"
Aug 05 05:38:44.837626 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.837594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-6scdb" event={"ID":"adb9b652-3f2c-4b3f-ae15-5015cb964973","Type":"ContainerStarted","Data":"68f07db4b7e085cc07c8553ea83f812da4dfce7a398208144b58d7c4ab8bf4d8"}
Aug 05 05:38:44.837784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.837639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-6scdb" event={"ID":"adb9b652-3f2c-4b3f-ae15-5015cb964973","Type":"ContainerStarted","Data":"ab387a58a97aa59360bc0274ba567796e026bcc62e07afef73932e515789c6aa"}
Aug 05 05:38:44.857022 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:44.856973    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-6scdb" podStartSLOduration=1.856956985 podStartE2EDuration="1.856956985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:38:44.856311239 +0000 UTC m=+168.265970186" watchObservedRunningTime="2026-08-05 05:38:44.856956985 +0000 UTC m=+168.266615924"
Aug 05 05:38:45.144687 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:45.144614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:45.145088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:45.144713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:45.145088 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.144789    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:53.144765978 +0000 UTC m=+176.554424925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : configmap references non-existent config key: service-ca.crt
Aug 05 05:38:45.145088 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.144883    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 05:38:45.145088 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.144974    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs podName:e44da256-f1f0-432b-8f5d-3b60c06fbd2b nodeName:}" failed. No retries permitted until 2026-08-05 05:38:53.144937281 +0000 UTC m=+176.554596208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs") pod "router-default-fffdc8c78-5j4zb" (UID: "e44da256-f1f0-432b-8f5d-3b60c06fbd2b") : secret "router-metrics-certs-default" not found
Aug 05 05:38:45.762917 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:45.762890    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5brmv_21ed34a4-0787-4540-8e68-9e60e18b794d/node-ca/0.log"
Aug 05 05:38:45.952723 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:45.952689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:45.952901 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:45.952786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:45.952901 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.952871    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 05:38:45.953060 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.952925    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:45.953060 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.952965    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:49.952925865 +0000 UTC m=+173.362584791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : configmap "kube-rbac-proxy" not found
Aug 05 05:38:45.953060 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:45.953016    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:49.95299494 +0000 UTC m=+173.362653876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:46.965389 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:46.965360    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vtk9x_14dfc461-68c5-42bd-b52e-77089576ba07/serve-healthcheck-canary/0.log"
Aug 05 05:38:48.235581 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:48.235547    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:38:49.990324 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:49.990244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:49.990718 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:49.990394    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:49.990718 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:49.990411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:49.990718 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:49.990456    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:57.990439087 +0000 UTC m=+181.400098013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : secret "insights-runtime-extractor-tls" not found
Aug 05 05:38:49.990718 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:49.990494    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 05:38:49.990718 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:38:49.990565    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm podName:ebc321d6-1b0b-4b47-ab06-361771aa1257 nodeName:}" failed. No retries permitted until 2026-08-05 05:38:57.990534943 +0000 UTC m=+181.400193868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6fm" (UID: "ebc321d6-1b0b-4b47-ab06-361771aa1257") : configmap "kube-rbac-proxy" not found
Aug 05 05:38:53.220776 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.220741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:53.221248 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.220890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:53.221577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.221548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-service-ca-bundle\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:53.223108 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.223088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e44da256-f1f0-432b-8f5d-3b60c06fbd2b-metrics-certs\") pod \"router-default-fffdc8c78-5j4zb\" (UID: \"e44da256-f1f0-432b-8f5d-3b60c06fbd2b\") " pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:53.264060 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.264033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:53.387495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.387466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-fffdc8c78-5j4zb"]
Aug 05 05:38:53.391629 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:53.391599    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44da256_f1f0_432b_8f5d_3b60c06fbd2b.slice/crio-eb1cbfabbac87cdeac9967082980130f128885a718c4c73bca167b235238f630 WatchSource:0}: Error finding container eb1cbfabbac87cdeac9967082980130f128885a718c4c73bca167b235238f630: Status 404 returned error can't find the container with id eb1cbfabbac87cdeac9967082980130f128885a718c4c73bca167b235238f630
Aug 05 05:38:53.865822 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.865784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fffdc8c78-5j4zb" event={"ID":"e44da256-f1f0-432b-8f5d-3b60c06fbd2b","Type":"ContainerStarted","Data":"f9ef75ec26034b41cd1cc5f48e64696681aa4be70965141cebbdc6f84469081c"}
Aug 05 05:38:53.866010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.865848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-fffdc8c78-5j4zb" event={"ID":"e44da256-f1f0-432b-8f5d-3b60c06fbd2b","Type":"ContainerStarted","Data":"eb1cbfabbac87cdeac9967082980130f128885a718c4c73bca167b235238f630"}
Aug 05 05:38:53.887436 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:53.887392    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-fffdc8c78-5j4zb" podStartSLOduration=16.887377234 podStartE2EDuration="16.887377234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:38:53.886669342 +0000 UTC m=+177.296328289" watchObservedRunningTime="2026-08-05 05:38:53.887377234 +0000 UTC m=+177.297036236"
Aug 05 05:38:54.264588 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:54.264549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:54.266896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:54.266874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:54.868772 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:54.868742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:54.869965 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:54.869926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-fffdc8c78-5j4zb"
Aug 05 05:38:58.058243 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.058207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:58.058717 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.058275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:58.058807 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.058710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebc321d6-1b0b-4b47-ab06-361771aa1257-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:58.060595 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.060573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebc321d6-1b0b-4b47-ab06-361771aa1257-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6fm\" (UID: \"ebc321d6-1b0b-4b47-ab06-361771aa1257\") " pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:58.109103 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.109076    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q6jl7\""
Aug 05 05:38:58.117196 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.117177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6fm"
Aug 05 05:38:58.244925 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.244891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6fm"]
Aug 05 05:38:58.248096 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:38:58.248070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc321d6_1b0b_4b47_ab06_361771aa1257.slice/crio-d0b76097d19974f71b60eefad8c4b57d6f83281bd40a887a0377c2081d09f5d2 WatchSource:0}: Error finding container d0b76097d19974f71b60eefad8c4b57d6f83281bd40a887a0377c2081d09f5d2: Status 404 returned error can't find the container with id d0b76097d19974f71b60eefad8c4b57d6f83281bd40a887a0377c2081d09f5d2
Aug 05 05:38:58.883197 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.883166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6fm" event={"ID":"ebc321d6-1b0b-4b47-ab06-361771aa1257","Type":"ContainerStarted","Data":"fbf9d1be78a9d7639b10d9709a59602cb45a0ca98a94986af35a7d17f556fe9a"}
Aug 05 05:38:58.883343 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:58.883220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6fm" event={"ID":"ebc321d6-1b0b-4b47-ab06-361771aa1257","Type":"ContainerStarted","Data":"d0b76097d19974f71b60eefad8c4b57d6f83281bd40a887a0377c2081d09f5d2"}
Aug 05 05:38:59.888743 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:38:59.888709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6fm" event={"ID":"ebc321d6-1b0b-4b47-ab06-361771aa1257","Type":"ContainerStarted","Data":"15cf649456e74a17a67e08bce24e517ca64f9e5d87113af2b47e5508dfe5a38f"}
Aug 05 05:39:00.893543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:00.893514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6fm" event={"ID":"ebc321d6-1b0b-4b47-ab06-361771aa1257","Type":"ContainerStarted","Data":"96c841ab7b46d8749664f1084f7c6e8657fa77dd5662fc547705125645e932a1"}
Aug 05 05:39:00.913215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:00.913173    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nj6fm" podStartSLOduration=17.047406483 podStartE2EDuration="18.913158712s" totalImagesPullingTime="1.865752229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 05:38:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:00.912278239 +0000 UTC m=+184.321937184" watchObservedRunningTime="2026-08-05 05:39:00.913158712 +0000 UTC m=+184.322817658"
Aug 05 05:39:05.149820 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.149791    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-2kmvb"]
Aug 05 05:39:05.152392 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.152373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:05.154505 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.154473    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 05:39:05.154505 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.154488    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 05:39:05.154702 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.154581    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wc2v5\""
Aug 05 05:39:05.166128 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.166104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-2kmvb"]
Aug 05 05:39:05.216005 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.215969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbftv\" (UniqueName: \"kubernetes.io/projected/a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0-kube-api-access-gbftv\") pod \"downloads-77c974ffcf-2kmvb\" (UID: \"a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0\") " pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:05.317131 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.317102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbftv\" (UniqueName: \"kubernetes.io/projected/a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0-kube-api-access-gbftv\") pod \"downloads-77c974ffcf-2kmvb\" (UID: \"a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0\") " pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:05.337714 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.337687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbftv\" (UniqueName: \"kubernetes.io/projected/a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0-kube-api-access-gbftv\") pod \"downloads-77c974ffcf-2kmvb\" (UID: \"a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0\") " pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:05.460339 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.460264    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:05.585157 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.585124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-2kmvb"]
Aug 05 05:39:05.588591 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:05.588566    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d0e4cf_1b7e_4a7c_bcb1_c0608ea346a0.slice/crio-8672f0cba9a9f12016db48eaeae3d83acb72ee71a36ee820b9b8bd526fddea3e WatchSource:0}: Error finding container 8672f0cba9a9f12016db48eaeae3d83acb72ee71a36ee820b9b8bd526fddea3e: Status 404 returned error can't find the container with id 8672f0cba9a9f12016db48eaeae3d83acb72ee71a36ee820b9b8bd526fddea3e
Aug 05 05:39:05.908414 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:05.908371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-2kmvb" event={"ID":"a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0","Type":"ContainerStarted","Data":"8672f0cba9a9f12016db48eaeae3d83acb72ee71a36ee820b9b8bd526fddea3e"}
Aug 05 05:39:10.087370 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.087334    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:39:10.090885 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.090863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.093257 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.093236    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 05 05:39:10.093876 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.093846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 05 05:39:10.093992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.093904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 05 05:39:10.093992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.093983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 05 05:39:10.094109 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.094083    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 05 05:39:10.094323 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.094304    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rn2hq\""
Aug 05 05:39:10.098053 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.098029    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 05 05:39:10.101437 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.100960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:39:10.158220 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmd6\" (UniqueName: \"kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.158609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.158564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259379 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259379 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259630 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259630 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259733 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmd6\" (UniqueName: \"kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259733 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.259839 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.259771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.260282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.260189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.260282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.260189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.260452 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.260422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.260626 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.260597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.262395 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.262377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.262493 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.262451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.271242 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.271221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmd6\" (UniqueName: \"kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6\") pod \"console-bcc567988-lbhf2\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") " pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.404441 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.404370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:10.547034 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.546993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:39:10.550593 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:10.550546    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8792a7_92be_4527_9491_9ba6baae079a.slice/crio-ee829e0649598ca26c4d496ea32dd8c740999b1818a5d46669d7adf709799d4c WatchSource:0}: Error finding container ee829e0649598ca26c4d496ea32dd8c740999b1818a5d46669d7adf709799d4c: Status 404 returned error can't find the container with id ee829e0649598ca26c4d496ea32dd8c740999b1818a5d46669d7adf709799d4c
Aug 05 05:39:10.928245 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:10.928201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcc567988-lbhf2" event={"ID":"eb8792a7-92be-4527-9491-9ba6baae079a","Type":"ContainerStarted","Data":"ee829e0649598ca26c4d496ea32dd8c740999b1818a5d46669d7adf709799d4c"}
Aug 05 05:39:11.603409 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:11.603308    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" podUID="db297c3f-6d17-41b4-94a1-da53e0ae0fd9" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Aug 05 05:39:11.934019 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:11.933869    2581 generic.go:356] "Generic (PLEG): container finished" podID="db297c3f-6d17-41b4-94a1-da53e0ae0fd9" containerID="caf08f0aa6b28e81ddfeb2a91a8f668c42a6cf92e18cb5d2b5d13ff8ed72a1c1" exitCode=1
Aug 05 05:39:11.934019 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:11.933971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" event={"ID":"db297c3f-6d17-41b4-94a1-da53e0ae0fd9","Type":"ContainerDied","Data":"caf08f0aa6b28e81ddfeb2a91a8f668c42a6cf92e18cb5d2b5d13ff8ed72a1c1"}
Aug 05 05:39:11.934364 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:11.934347    2581 scope.go:117] "RemoveContainer" containerID="caf08f0aa6b28e81ddfeb2a91a8f668c42a6cf92e18cb5d2b5d13ff8ed72a1c1"
Aug 05 05:39:12.940781 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:12.940747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf" event={"ID":"db297c3f-6d17-41b4-94a1-da53e0ae0fd9","Type":"ContainerStarted","Data":"f86d0adbfcdd0c18212b54e0458ccbdf9ef5235dafd91daf3ceeb1ed04ee7ed2"}
Aug 05 05:39:12.941243 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:12.941093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:39:12.941776 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:12.941724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c4dd689f7-rp7jf"
Aug 05 05:39:13.947016 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:13.946978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcc567988-lbhf2" event={"ID":"eb8792a7-92be-4527-9491-9ba6baae079a","Type":"ContainerStarted","Data":"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"}
Aug 05 05:39:13.966237 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:13.966193    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcc567988-lbhf2" podStartSLOduration=1.093817033 podStartE2EDuration="3.966180539s" totalImagesPullingTime="2.872363506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:13.965562942 +0000 UTC m=+197.375221890" watchObservedRunningTime="2026-08-05 05:39:13.966180539 +0000 UTC m=+197.375839484"
Aug 05 05:39:20.404539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.404486    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:20.405011 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.404574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:20.410316 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.410291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:20.793806 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.793670    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"]
Aug 05 05:39:20.797331 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.797305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.801823 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.801316    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 05 05:39:20.801823 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.801565    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 05:39:20.803158 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.802803    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 05 05:39:20.803158 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.802891    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 05:39:20.803158 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.803045    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 05 05:39:20.803726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.803497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j8x2v\""
Aug 05 05:39:20.803726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.803572    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 05:39:20.826581 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.826486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"]
Aug 05 05:39:20.827967 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.827937    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qs2h2"]
Aug 05 05:39:20.831437 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.831422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.835255 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.835239    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 05:39:20.836215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.835470    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 05:39:20.836215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.835518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wjrwm\""
Aug 05 05:39:20.836215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.836081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 05:39:20.856533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.856639 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.856698 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.856698 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.856698 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrs5\" (UniqueName: \"kubernetes.io/projected/61856c73-7729-4624-a8be-aa2d2fece968-kube-api-access-whrs5\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.856850 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.856727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61856c73-7729-4624-a8be-aa2d2fece968-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.957755 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.957933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.957933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-accelerators-collector-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.957933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-metrics-client-ca\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.957933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-sys\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.957933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-tls\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.957985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-root\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrs5\" (UniqueName: \"kubernetes.io/projected/61856c73-7729-4624-a8be-aa2d2fece968-kube-api-access-whrs5\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9cp2\" (UniqueName: \"kubernetes.io/projected/47ace3ef-2f29-495d-beb9-385644381b46-kube-api-access-p9cp2\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61856c73-7729-4624-a8be-aa2d2fece968-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.958199 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-textfile\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.958524 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.958524 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-wtmp\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:20.958524 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:39:20.958362    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Aug 05 05:39:20.958524 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:39:20.958429    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls podName:61856c73-7729-4624-a8be-aa2d2fece968 nodeName:}" failed. No retries permitted until 2026-08-05 05:39:21.458410717 +0000 UTC m=+204.868069648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-k9rq7" (UID: "61856c73-7729-4624-a8be-aa2d2fece968") : secret "kube-state-metrics-tls" not found
Aug 05 05:39:20.959128 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.958978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.959128 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.959073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61856c73-7729-4624-a8be-aa2d2fece968-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.959574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.959554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.961925 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.961898    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.975274 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.975213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrs5\" (UniqueName: \"kubernetes.io/projected/61856c73-7729-4624-a8be-aa2d2fece968-kube-api-access-whrs5\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:20.978293 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:20.978241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-sys\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-tls\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-root\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9cp2\" (UniqueName: \"kubernetes.io/projected/47ace3ef-2f29-495d-beb9-385644381b46-kube-api-access-p9cp2\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-textfile\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-wtmp\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-accelerators-collector-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-wtmp\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-metrics-client-ca\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.060403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.059784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-sys\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.061062 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.060773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47ace3ef-2f29-495d-beb9-385644381b46-root\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.061639 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.061214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-textfile\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.062315 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.062279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-accelerators-collector-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.062791 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.062739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47ace3ef-2f29-495d-beb9-385644381b46-metrics-client-ca\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.065633 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.065593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-tls\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.066978 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.066931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47ace3ef-2f29-495d-beb9-385644381b46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.074635 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.073268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9cp2\" (UniqueName: \"kubernetes.io/projected/47ace3ef-2f29-495d-beb9-385644381b46-kube-api-access-p9cp2\") pod \"node-exporter-qs2h2\" (UID: \"47ace3ef-2f29-495d-beb9-385644381b46\") " pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.145680 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.145644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qs2h2"
Aug 05 05:39:21.455400 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:21.455370    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ace3ef_2f29_495d_beb9_385644381b46.slice/crio-8852450f877ddb64054b43d33f8b3993c2ccefe776b71f162f74153f207e8553 WatchSource:0}: Error finding container 8852450f877ddb64054b43d33f8b3993c2ccefe776b71f162f74153f207e8553: Status 404 returned error can't find the container with id 8852450f877ddb64054b43d33f8b3993c2ccefe776b71f162f74153f207e8553
Aug 05 05:39:21.463437 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.463411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:21.465755 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.465729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61856c73-7729-4624-a8be-aa2d2fece968-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-k9rq7\" (UID: \"61856c73-7729-4624-a8be-aa2d2fece968\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:21.708902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.708823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"
Aug 05 05:39:21.880965 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.880619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7"]
Aug 05 05:39:21.888490 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:21.888447    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61856c73_7729_4624_a8be_aa2d2fece968.slice/crio-1ddf50e59622f81ac945582c1b04070601258a7565155893c4f03541ff7a4c78 WatchSource:0}: Error finding container 1ddf50e59622f81ac945582c1b04070601258a7565155893c4f03541ff7a4c78: Status 404 returned error can't find the container with id 1ddf50e59622f81ac945582c1b04070601258a7565155893c4f03541ff7a4c78
Aug 05 05:39:21.983102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.981463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7" event={"ID":"61856c73-7729-4624-a8be-aa2d2fece968","Type":"ContainerStarted","Data":"1ddf50e59622f81ac945582c1b04070601258a7565155893c4f03541ff7a4c78"}
Aug 05 05:39:21.986380 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.985804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-2kmvb" event={"ID":"a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0","Type":"ContainerStarted","Data":"c9b8acba6109addf8ab03c68479fe38ea0859d1d402004d17e715ebb740b16f6"}
Aug 05 05:39:21.986380 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.986185    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:21.989539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.989510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qs2h2" event={"ID":"47ace3ef-2f29-495d-beb9-385644381b46","Type":"ContainerStarted","Data":"8852450f877ddb64054b43d33f8b3993c2ccefe776b71f162f74153f207e8553"}
Aug 05 05:39:21.997811 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:21.997763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-2kmvb"
Aug 05 05:39:22.018882 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:22.017812    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-2kmvb" podStartSLOduration=1.067920875 podStartE2EDuration="17.017792135s" totalImagesPullingTime="15.94987126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:22.016126595 +0000 UTC m=+205.425785543" watchObservedRunningTime="2026-08-05 05:39:22.017792135 +0000 UTC m=+205.427451083"
Aug 05 05:39:22.990785 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:22.990506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"]
Aug 05 05:39:22.996461 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:22.996429    2581 generic.go:356] "Generic (PLEG): container finished" podID="47ace3ef-2f29-495d-beb9-385644381b46" containerID="e5b0437e4e3d4d65e20ad76cb3699f8dd024bcb29ffe69b4ac8f4e9c5e2ac18b" exitCode=0
Aug 05 05:39:22.996595 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:22.996522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qs2h2" event={"ID":"47ace3ef-2f29-495d-beb9-385644381b46","Type":"ContainerDied","Data":"e5b0437e4e3d4d65e20ad76cb3699f8dd024bcb29ffe69b4ac8f4e9c5e2ac18b"}
Aug 05 05:39:22.996834 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:22.996807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.005152 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.005129    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 05 05:39:23.005548 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.005532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 05 05:39:23.005636 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.005581    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 05 05:39:23.005835 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.005730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 05 05:39:23.006001 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.005907    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kdl8t\""
Aug 05 05:39:23.006146 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.006128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 05 05:39:23.006414 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.006389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-boc3hgoj9d41f\""
Aug 05 05:39:23.045116 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.045064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"]
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-grpc-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-metrics-client-ca\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddqhg\" (UniqueName: \"kubernetes.io/projected/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-kube-api-access-ddqhg\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.080695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.080518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.081205 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.081180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.182679 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.182634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.182874 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.182782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.182874 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.182823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-metrics-client-ca\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.183028 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.182882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddqhg\" (UniqueName: \"kubernetes.io/projected/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-kube-api-access-ddqhg\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.183028 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.183008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.183137 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.183039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.183137 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.183089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.183137 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.183123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-grpc-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.184645 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.184594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-metrics-client-ca\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.185914 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.185880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.186387 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.186363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.186622 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.186591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.187494 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.187447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.187590 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.187495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-grpc-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.188071 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.188032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-secret-thanos-querier-tls\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.211967 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.211342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddqhg\" (UniqueName: \"kubernetes.io/projected/4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44-kube-api-access-ddqhg\") pod \"thanos-querier-74bb5d789f-jh9gp\" (UID: \"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44\") " pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.309877 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.309777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:23.499138 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:23.499071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"]
Aug 05 05:39:23.501481 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:23.501445    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da20ad9_dbf6_4c14_b4a3_26d8a0ccaf44.slice/crio-f63ba5689edfedec1a3813358260a80a759c861ddf2e8f0da655ba5f82d6fd6d WatchSource:0}: Error finding container f63ba5689edfedec1a3813358260a80a759c861ddf2e8f0da655ba5f82d6fd6d: Status 404 returned error can't find the container with id f63ba5689edfedec1a3813358260a80a759c861ddf2e8f0da655ba5f82d6fd6d
Aug 05 05:39:24.003503 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:24.003386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7" event={"ID":"61856c73-7729-4624-a8be-aa2d2fece968","Type":"ContainerStarted","Data":"37a5fcd2df0ada1f3aad2853dc13158d126da52d9637d16cb34703d8d11a9e92"}
Aug 05 05:39:24.006658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:24.006625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qs2h2" event={"ID":"47ace3ef-2f29-495d-beb9-385644381b46","Type":"ContainerStarted","Data":"c5b50aba1676116927dfc20815592efc5a6f63cc0f200cc96e60d5410865624d"}
Aug 05 05:39:24.006768 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:24.006699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qs2h2" event={"ID":"47ace3ef-2f29-495d-beb9-385644381b46","Type":"ContainerStarted","Data":"9c515b1fd1791530553798e824bd345f20f405a0b68e8b35e62739b304238d00"}
Aug 05 05:39:24.007899 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:24.007872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"f63ba5689edfedec1a3813358260a80a759c861ddf2e8f0da655ba5f82d6fd6d"}
Aug 05 05:39:24.033885 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:24.032438    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qs2h2" podStartSLOduration=2.8925289100000002 podStartE2EDuration="4.032415392s" totalImagesPullingTime="1.057765759s" totalInitContainerRuntime="82.120723ms" isStatefulPod=true podCreationTimestamp="2026-08-05 05:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:24.031403286 +0000 UTC m=+207.441062248" watchObservedRunningTime="2026-08-05 05:39:24.032415392 +0000 UTC m=+207.442074340"
Aug 05 05:39:25.015019 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.014981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7" event={"ID":"61856c73-7729-4624-a8be-aa2d2fece968","Type":"ContainerStarted","Data":"ae946d81d4886acf56de389a2a6a77729d11495c1cbaffe360747857fb850a65"}
Aug 05 05:39:25.015477 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.015051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7" event={"ID":"61856c73-7729-4624-a8be-aa2d2fece968","Type":"ContainerStarted","Data":"68755a170631c1dc7b03064234decd4f0c496cb0bfa2f876691af7b7ff3025df"}
Aug 05 05:39:25.035477 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.035426    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-k9rq7" podStartSLOduration=3.132140949 podStartE2EDuration="5.035405644s" totalImagesPullingTime="1.903264695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:25.035009281 +0000 UTC m=+208.444668231" watchObservedRunningTime="2026-08-05 05:39:25.035405644 +0000 UTC m=+208.445064592"
Aug 05 05:39:25.531404 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.531357    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"]
Aug 05 05:39:25.567963 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.567109    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"]
Aug 05 05:39:25.567963 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.567237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.573016 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.572989    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t4kww\""
Aug 05 05:39:25.573369 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.573021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 05 05:39:25.712449 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.712410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bdaf09b-5488-4050-96a8-89eed70fa292-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.712617 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.712461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spv9p\" (UniqueName: \"kubernetes.io/projected/3bdaf09b-5488-4050-96a8-89eed70fa292-kube-api-access-spv9p\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.813758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.813685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bdaf09b-5488-4050-96a8-89eed70fa292-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.813758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.813724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spv9p\" (UniqueName: \"kubernetes.io/projected/3bdaf09b-5488-4050-96a8-89eed70fa292-kube-api-access-spv9p\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.816289 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.816260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3bdaf09b-5488-4050-96a8-89eed70fa292-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.822292 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.822265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spv9p\" (UniqueName: \"kubernetes.io/projected/3bdaf09b-5488-4050-96a8-89eed70fa292-kube-api-access-spv9p\") pod \"monitoring-plugin-6dffbbd67-4d7gh\" (UID: \"3bdaf09b-5488-4050-96a8-89eed70fa292\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:25.883764 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:25.883739    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:26.059003 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:26.058971    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"]
Aug 05 05:39:26.141388 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:26.141311    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdaf09b_5488_4050_96a8_89eed70fa292.slice/crio-eb43e87bb590dda674f190114dbf9320c68aba15dcf16a9769cbf21ba189198f WatchSource:0}: Error finding container eb43e87bb590dda674f190114dbf9320c68aba15dcf16a9769cbf21ba189198f: Status 404 returned error can't find the container with id eb43e87bb590dda674f190114dbf9320c68aba15dcf16a9769cbf21ba189198f
Aug 05 05:39:27.035190 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.035053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"a94e532a946bf656ee506b0301b31c0631d041cfcb3ea7ec1b1fda4f711dfdb5"}
Aug 05 05:39:27.035190 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.035180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"f6821d6a4b236535fa7c2fb392a4b0d0178960cc1217c549b4ea33ac727e18b9"}
Aug 05 05:39:27.035654 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.035224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"37f5cb550c55b808e2eb04d007353c2052af647332d2e5ed6fc1eff1a384d44f"}
Aug 05 05:39:27.037783 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.037587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh" event={"ID":"3bdaf09b-5488-4050-96a8-89eed70fa292","Type":"ContainerStarted","Data":"eb43e87bb590dda674f190114dbf9320c68aba15dcf16a9769cbf21ba189198f"}
Aug 05 05:39:27.244603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.244573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5898857596-qbpg4"]
Aug 05 05:39:27.245321 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:39:27.245284    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5898857596-qbpg4" podUID="a35f6396-abdb-42b6-837f-e9cae3bef2b7"
Aug 05 05:39:27.332031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.330605    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:39:27.345108 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.345081    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.353546 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.353506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:39:27.434589 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.434589 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.435054 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.435054 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfdq\" (UniqueName: \"kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.435054 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.435054 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.435054 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.434859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfdq\" (UniqueName: \"kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536495 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.536757 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.536501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.537091 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.537069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.537177 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.537098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.537675 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.537644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.537832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.537802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.539356 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.539335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.539545 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.539523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.549532 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.549513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfdq\" (UniqueName: \"kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq\") pod \"console-7dbdd8fc74-fqdzd\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") " pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:27.658269 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:27.658019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:28.041412 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.041382    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:39:28.063028 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.063002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:39:28.142549 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142510    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142679    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142726    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.142849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142785    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:39:28.142849 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.142809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hm65\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65\") pod \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\" (UID: \"a35f6396-abdb-42b6-837f-e9cae3bef2b7\") "
Aug 05 05:39:28.143102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.143081    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a35f6396-abdb-42b6-837f-e9cae3bef2b7-ca-trust-extracted\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.143166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.143146    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:28.143326 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.143280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:28.146056 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.146029    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65" (OuterVolumeSpecName: "kube-api-access-8hm65") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "kube-api-access-8hm65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:39:28.146166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.146141    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:39:28.146236 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.146216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:39:28.148602 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.148574    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a35f6396-abdb-42b6-837f-e9cae3bef2b7" (UID: "a35f6396-abdb-42b6-837f-e9cae3bef2b7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:39:28.243834 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243809    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-bound-sa-token\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.243938 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243837    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-certificates\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.243938 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243852    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hm65\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-kube-api-access-8hm65\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.243938 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243867    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-image-registry-private-configuration\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.243938 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243883    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a35f6396-abdb-42b6-837f-e9cae3bef2b7-installation-pull-secrets\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.243938 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.243898    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a35f6396-abdb-42b6-837f-e9cae3bef2b7-trusted-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:28.327669 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:28.327635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:39:28.336851 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:28.336776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0b2601_0dd1_43a6_a335_6aa7c4316842.slice/crio-9a991b42412c6e974b2487f47755acba65d9769a7e8db462e07d77978f69c540 WatchSource:0}: Error finding container 9a991b42412c6e974b2487f47755acba65d9769a7e8db462e07d77978f69c540: Status 404 returned error can't find the container with id 9a991b42412c6e974b2487f47755acba65d9769a7e8db462e07d77978f69c540
Aug 05 05:39:29.050000 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.049960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"676a2309941cd21a27bee386f2ad2da20a0d2cbab878c20139a3545711f70b2d"}
Aug 05 05:39:29.050186 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.050048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"0f1b23a0d82740f22c74c1d8858132c50f39686b3851752ff3aec2f220e81c63"}
Aug 05 05:39:29.050186 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.050088    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" event={"ID":"4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44","Type":"ContainerStarted","Data":"69f826026157cf89c80e73efab1160b5aaed8dafd5d99d8364e7c5b43eaec76c"}
Aug 05 05:39:29.050186 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.050137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:29.051966 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.051916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbdd8fc74-fqdzd" event={"ID":"0a0b2601-0dd1-43a6-a335-6aa7c4316842","Type":"ContainerStarted","Data":"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"}
Aug 05 05:39:29.052090 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.051977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbdd8fc74-fqdzd" event={"ID":"0a0b2601-0dd1-43a6-a335-6aa7c4316842","Type":"ContainerStarted","Data":"9a991b42412c6e974b2487f47755acba65d9769a7e8db462e07d77978f69c540"}
Aug 05 05:39:29.053490 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.053463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh" event={"ID":"3bdaf09b-5488-4050-96a8-89eed70fa292","Type":"ContainerStarted","Data":"6d721a6f741c0deb185438fcd6b968457ba0a4901dfdcb303a8bcc8ffc8c2ed9"}
Aug 05 05:39:29.053608 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.053469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5898857596-qbpg4"
Aug 05 05:39:29.053867 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.053845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:29.060300 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.060137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh"
Aug 05 05:39:29.083256 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.083208    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp" podStartSLOduration=2.75840736 podStartE2EDuration="7.083190256s" totalImagesPullingTime="4.324782896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:29.0828986 +0000 UTC m=+212.492557578" watchObservedRunningTime="2026-08-05 05:39:29.083190256 +0000 UTC m=+212.492849205"
Aug 05 05:39:29.132081 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.132048    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5898857596-qbpg4"]
Aug 05 05:39:29.141042 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.141007    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5898857596-qbpg4"]
Aug 05 05:39:29.165615 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.165561    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dbdd8fc74-fqdzd" podStartSLOduration=2.165544729 podStartE2EDuration="2.165544729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:29.164893708 +0000 UTC m=+212.574552656" watchObservedRunningTime="2026-08-05 05:39:29.165544729 +0000 UTC m=+212.575203676"
Aug 05 05:39:29.184315 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.184268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-4d7gh" podStartSLOduration=2.172113931 podStartE2EDuration="4.184251613s" totalImagesPullingTime="2.012137682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:29.18269327 +0000 UTC m=+212.592352231" watchObservedRunningTime="2026-08-05 05:39:29.184251613 +0000 UTC m=+212.593910559"
Aug 05 05:39:29.241696 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.241662    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35f6396-abdb-42b6-837f-e9cae3bef2b7" path="/var/lib/kubelet/pods/a35f6396-abdb-42b6-837f-e9cae3bef2b7/volumes"
Aug 05 05:39:29.253027 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:29.253004    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a35f6396-abdb-42b6-837f-e9cae3bef2b7-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:34.107231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.107197    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:39:34.143864 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.143831    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:39:34.171126 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.171096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:39:34.171268 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.171206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295298 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295298 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295298 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9fwq\" (UniqueName: \"kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295298 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295483 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.295483 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.295327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396342 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.396644 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.396587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9fwq\" (UniqueName: \"kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.397165 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.397136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.397282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.397140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.397282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.397140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.397427 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.397409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.398935 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.398911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.399354 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.399334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.406323 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.406305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9fwq\" (UniqueName: \"kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq\") pod \"console-7979c9bc58-h75jw\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") " pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.480057 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.480032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:34.632734 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:34.632711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:39:34.635205 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:39:34.635166    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cd1a49_9859_4742_91d5_d1ec3d3eb9f2.slice/crio-ee845d86e02e8dbcaaddc5db871503f4edbed5fa72bb1b299939c9bb55699f3d WatchSource:0}: Error finding container ee845d86e02e8dbcaaddc5db871503f4edbed5fa72bb1b299939c9bb55699f3d: Status 404 returned error can't find the container with id ee845d86e02e8dbcaaddc5db871503f4edbed5fa72bb1b299939c9bb55699f3d
Aug 05 05:39:35.064103 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:35.064074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74bb5d789f-jh9gp"
Aug 05 05:39:35.075896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:35.075873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979c9bc58-h75jw" event={"ID":"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2","Type":"ContainerStarted","Data":"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"}
Aug 05 05:39:35.076049 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:35.075912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979c9bc58-h75jw" event={"ID":"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2","Type":"ContainerStarted","Data":"ee845d86e02e8dbcaaddc5db871503f4edbed5fa72bb1b299939c9bb55699f3d"}
Aug 05 05:39:35.107896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:35.107839    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7979c9bc58-h75jw" podStartSLOduration=1.107819419 podStartE2EDuration="1.107819419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:39:35.105620765 +0000 UTC m=+218.515279713" watchObservedRunningTime="2026-08-05 05:39:35.107819419 +0000 UTC m=+218.517478367"
Aug 05 05:39:37.659048 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:37.659007    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:44.480753 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:44.480719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:44.481418 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:44.480785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:44.485740 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:44.485718    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:45.115964 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:45.115921    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:39:45.167403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:45.167371    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:39:52.136555 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:52.136525    2581 generic.go:356] "Generic (PLEG): container finished" podID="7a57edde-4f0e-4e0f-af84-55647db789bc" containerID="e9f0fe454f122c0cd4bca5de856811a6c72d0643a66c93c86b9162ece9e085ea" exitCode=0
Aug 05 05:39:52.136923 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:52.136576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-x2dgc" event={"ID":"7a57edde-4f0e-4e0f-af84-55647db789bc","Type":"ContainerDied","Data":"e9f0fe454f122c0cd4bca5de856811a6c72d0643a66c93c86b9162ece9e085ea"}
Aug 05 05:39:52.136923 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:52.136873    2581 scope.go:117] "RemoveContainer" containerID="e9f0fe454f122c0cd4bca5de856811a6c72d0643a66c93c86b9162ece9e085ea"
Aug 05 05:39:53.071285 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:53.071245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fffdc8c78-5j4zb_e44da256-f1f0-432b-8f5d-3b60c06fbd2b/router/0.log"
Aug 05 05:39:53.106039 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:53.106003    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vtk9x_14dfc461-68c5-42bd-b52e-77089576ba07/serve-healthcheck-canary/0.log"
Aug 05 05:39:53.141831 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:53.141800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-x2dgc" event={"ID":"7a57edde-4f0e-4e0f-af84-55647db789bc","Type":"ContainerStarted","Data":"27cb447d619eb097e4756c39e00e849a1ca0beac590714dbceb7c52e28ac3182"}
Aug 05 05:39:59.125829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.125769    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dbdd8fc74-fqdzd" podUID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" containerName="console" containerID="cri-o://af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09" gracePeriod=15
Aug 05 05:39:59.391371 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.391301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:39:59.511796 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511805    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511849    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511898    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.511989    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512270 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.512030    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttfdq\" (UniqueName: \"kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq\") pod \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\" (UID: \"0a0b2601-0dd1-43a6-a335-6aa7c4316842\") "
Aug 05 05:39:59.512270 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.512247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config" (OuterVolumeSpecName: "console-config") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:59.512382 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.512327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:59.512435 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.512415    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:59.512481 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.512438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:39:59.514353 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.514329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:39:59.514353 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.514339    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq" (OuterVolumeSpecName: "kube-api-access-ttfdq") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "kube-api-access-ttfdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:39:59.514353 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.514348    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a0b2601-0dd1-43a6-a335-6aa7c4316842" (UID: "0a0b2601-0dd1-43a6-a335-6aa7c4316842"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:39:59.613381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613350    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613378    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613381 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613387    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613397    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613406    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttfdq\" (UniqueName: \"kubernetes.io/projected/0a0b2601-0dd1-43a6-a335-6aa7c4316842-kube-api-access-ttfdq\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613415    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a0b2601-0dd1-43a6-a335-6aa7c4316842-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:39:59.613606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:39:59.613423    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a0b2601-0dd1-43a6-a335-6aa7c4316842-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:00.168567 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.168534    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" containerID="af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09" exitCode=0
Aug 05 05:40:00.169078 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.168576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbdd8fc74-fqdzd" event={"ID":"0a0b2601-0dd1-43a6-a335-6aa7c4316842","Type":"ContainerDied","Data":"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"}
Aug 05 05:40:00.169078 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.168586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbdd8fc74-fqdzd"
Aug 05 05:40:00.169078 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.168612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbdd8fc74-fqdzd" event={"ID":"0a0b2601-0dd1-43a6-a335-6aa7c4316842","Type":"ContainerDied","Data":"9a991b42412c6e974b2487f47755acba65d9769a7e8db462e07d77978f69c540"}
Aug 05 05:40:00.169078 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.168645    2581 scope.go:117] "RemoveContainer" containerID="af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"
Aug 05 05:40:00.182629 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.182610    2581 scope.go:117] "RemoveContainer" containerID="af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"
Aug 05 05:40:00.182912 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:40:00.182892    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09\": container with ID starting with af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09 not found: ID does not exist" containerID="af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"
Aug 05 05:40:00.183020 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.182925    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09"} err="failed to get container status \"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09\": rpc error: code = NotFound desc = could not find container \"af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09\": container with ID starting with af18a8eeadc1c9c0cca793c83e68c54d08e254ab13b959a6f8b3680b70a6eb09 not found: ID does not exist"
Aug 05 05:40:00.193493 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.193462    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:40:00.194782 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:00.194758    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dbdd8fc74-fqdzd"]
Aug 05 05:40:01.173992 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:01.173964    2581 generic.go:356] "Generic (PLEG): container finished" podID="bae5b21c-f10b-4f75-bc55-370509f0c111" containerID="85233de5686a48d4ab98189b00538a47373b87001fa52950cc2559abb7ce82b3" exitCode=0
Aug 05 05:40:01.174463 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:01.174024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp" event={"ID":"bae5b21c-f10b-4f75-bc55-370509f0c111","Type":"ContainerDied","Data":"85233de5686a48d4ab98189b00538a47373b87001fa52950cc2559abb7ce82b3"}
Aug 05 05:40:01.174463 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:01.174408    2581 scope.go:117] "RemoveContainer" containerID="85233de5686a48d4ab98189b00538a47373b87001fa52950cc2559abb7ce82b3"
Aug 05 05:40:01.242415 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:01.242385    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" path="/var/lib/kubelet/pods/0a0b2601-0dd1-43a6-a335-6aa7c4316842/volumes"
Aug 05 05:40:02.180095 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:02.180062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-pxxvp" event={"ID":"bae5b21c-f10b-4f75-bc55-370509f0c111","Type":"ContainerStarted","Data":"274b9d835086bd2aea204ff887c51b4bc969841a12a4c1bf2dc211b821260a5f"}
Aug 05 05:40:08.898369 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:08.898330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:40:08.900664 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:08.900639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d5d27ff-1728-4820-a619-935ef6094cd9-metrics-certs\") pod \"network-metrics-daemon-47xz4\" (UID: \"8d5d27ff-1728-4820-a619-935ef6094cd9\") " pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:40:08.939123 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:08.939092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jmhv\""
Aug 05 05:40:08.947045 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:08.947027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47xz4"
Aug 05 05:40:09.095582 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:09.095555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47xz4"]
Aug 05 05:40:09.098436 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:40:09.098407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5d27ff_1728_4820_a619_935ef6094cd9.slice/crio-9dae878fa5de650c9aa7237b47b7a96c33b5d4f370e82696b8b203bf178ba3a5 WatchSource:0}: Error finding container 9dae878fa5de650c9aa7237b47b7a96c33b5d4f370e82696b8b203bf178ba3a5: Status 404 returned error can't find the container with id 9dae878fa5de650c9aa7237b47b7a96c33b5d4f370e82696b8b203bf178ba3a5
Aug 05 05:40:09.206670 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:09.206589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47xz4" event={"ID":"8d5d27ff-1728-4820-a619-935ef6094cd9","Type":"ContainerStarted","Data":"9dae878fa5de650c9aa7237b47b7a96c33b5d4f370e82696b8b203bf178ba3a5"}
Aug 05 05:40:10.189752 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.189686    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bcc567988-lbhf2" podUID="eb8792a7-92be-4527-9491-9ba6baae079a" containerName="console" containerID="cri-o://bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021" gracePeriod=15
Aug 05 05:40:10.213219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.213190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47xz4" event={"ID":"8d5d27ff-1728-4820-a619-935ef6094cd9","Type":"ContainerStarted","Data":"742bb52d676fe8093e7afbffd90bd4b54703c125b6eea92c2164b794ce8e559f"}
Aug 05 05:40:10.213360 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.213239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47xz4" event={"ID":"8d5d27ff-1728-4820-a619-935ef6094cd9","Type":"ContainerStarted","Data":"641c1acfcbf49be96722bd067055c5b18bff3d39c93e6f23a2585ba3d223c5e8"}
Aug 05 05:40:10.232611 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.232560    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-47xz4" podStartSLOduration=251.344756438 podStartE2EDuration="4m12.232518048s" totalImagesPullingTime="887.76161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:40:10.230761834 +0000 UTC m=+253.640420785" watchObservedRunningTime="2026-08-05 05:40:10.232518048 +0000 UTC m=+253.642176996"
Aug 05 05:40:10.432321 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.432293    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:40:10.514889 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.514857    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmd6\" (UniqueName: \"kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515072 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.514904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515072 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.514931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515072 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515187 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515139    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515187 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515291 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515221    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config\") pod \"eb8792a7-92be-4527-9491-9ba6baae079a\" (UID: \"eb8792a7-92be-4527-9491-9ba6baae079a\") "
Aug 05 05:40:10.515569 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515464    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:40:10.515569 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:40:10.515569 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515562    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.515784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515583    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:40:10.515784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.515749    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config" (OuterVolumeSpecName: "console-config") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:40:10.517198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.517176    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:40:10.517198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.517191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6" (OuterVolumeSpecName: "kube-api-access-gjmd6") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "kube-api-access-gjmd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:40:10.517303 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.517194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb8792a7-92be-4527-9491-9ba6baae079a" (UID: "eb8792a7-92be-4527-9491-9ba6baae079a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616844    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616872    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmd6\" (UniqueName: \"kubernetes.io/projected/eb8792a7-92be-4527-9491-9ba6baae079a-kube-api-access-gjmd6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616882    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616891    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616901    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb8792a7-92be-4527-9491-9ba6baae079a-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:10.616941 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:10.616909    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb8792a7-92be-4527-9491-9ba6baae079a-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:40:11.217903 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.217871    2581 generic.go:356] "Generic (PLEG): container finished" podID="eb8792a7-92be-4527-9491-9ba6baae079a" containerID="bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021" exitCode=0
Aug 05 05:40:11.218294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.217913    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcc567988-lbhf2"
Aug 05 05:40:11.218294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.217973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcc567988-lbhf2" event={"ID":"eb8792a7-92be-4527-9491-9ba6baae079a","Type":"ContainerDied","Data":"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"}
Aug 05 05:40:11.218294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.218022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcc567988-lbhf2" event={"ID":"eb8792a7-92be-4527-9491-9ba6baae079a","Type":"ContainerDied","Data":"ee829e0649598ca26c4d496ea32dd8c740999b1818a5d46669d7adf709799d4c"}
Aug 05 05:40:11.218294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.218044    2581 scope.go:117] "RemoveContainer" containerID="bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"
Aug 05 05:40:11.226688 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.226671    2581 scope.go:117] "RemoveContainer" containerID="bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"
Aug 05 05:40:11.226941 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:40:11.226923    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021\": container with ID starting with bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021 not found: ID does not exist" containerID="bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"
Aug 05 05:40:11.227010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.226969    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021"} err="failed to get container status \"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021\": rpc error: code = NotFound desc = could not find container \"bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021\": container with ID starting with bdc19814741c83576efa6b45fc92e6fc34b0dad31f13e8e0fb2f3792f7182021 not found: ID does not exist"
Aug 05 05:40:11.240728 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.240708    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:40:11.246032 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:11.246009    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcc567988-lbhf2"]
Aug 05 05:40:13.240198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:13.240158    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8792a7-92be-4527-9491-9ba6baae079a" path="/var/lib/kubelet/pods/eb8792a7-92be-4527-9491-9ba6baae079a/volumes"
Aug 05 05:40:38.796733 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:40:38.796669    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htl9b" podUID="40d88b81-cd88-450d-b900-fa18ac50a693"
Aug 05 05:40:38.796733 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:40:38.796672    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2" podUID="a98b470c-b616-42e8-9672-bac000436b06"
Aug 05 05:40:39.326748 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:39.326716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:39.326966 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:39.326718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:40:40.039080 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039048    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039472    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8792a7-92be-4527-9491-9ba6baae079a" containerName="console"
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039488    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8792a7-92be-4527-9491-9ba6baae079a" containerName="console"
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039517    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" containerName="console"
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039526    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" containerName="console"
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039598    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8792a7-92be-4527-9491-9ba6baae079a" containerName="console"
Aug 05 05:40:40.039671 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.039612    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0b2601-0dd1-43a6-a335-6aa7c4316842" containerName="console"
Aug 05 05:40:40.042391 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.042370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.055899 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.055874    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:40:40.060903 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.060880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vlp\" (UniqueName: \"kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.060912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.061000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.061020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061221 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.061076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061221 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.061108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.061221 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.061138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.162551 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.162514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.162551 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.162548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.162776 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.162577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.162908 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.162881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vlp\" (UniqueName: \"kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.162983 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.162933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163246 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163346 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163484 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163612 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163650 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.163925 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.163905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.165200 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.165156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.165403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.165387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.170787 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.170767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vlp\" (UniqueName: \"kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp\") pod \"console-55f6c7887b-xwdf6\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") " pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.352052 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.351941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:40.480982 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:40.480937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:40:40.483904 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:40:40.483877    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b8c23f_ebb5_4d73_9d44_eee6c195065e.slice/crio-31f41b14292d7ae52b10cd590feb7f976f8c3d1e32131cb0dbe8ecb6f48d3a6d WatchSource:0}: Error finding container 31f41b14292d7ae52b10cd590feb7f976f8c3d1e32131cb0dbe8ecb6f48d3a6d: Status 404 returned error can't find the container with id 31f41b14292d7ae52b10cd590feb7f976f8c3d1e32131cb0dbe8ecb6f48d3a6d
Aug 05 05:40:41.335101 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:41.335064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7887b-xwdf6" event={"ID":"a7b8c23f-ebb5-4d73-9d44-eee6c195065e","Type":"ContainerStarted","Data":"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"}
Aug 05 05:40:41.335101 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:41.335110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7887b-xwdf6" event={"ID":"a7b8c23f-ebb5-4d73-9d44-eee6c195065e","Type":"ContainerStarted","Data":"31f41b14292d7ae52b10cd590feb7f976f8c3d1e32131cb0dbe8ecb6f48d3a6d"}
Aug 05 05:40:41.354995 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:41.354927    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f6c7887b-xwdf6" podStartSLOduration=1.354913437 podStartE2EDuration="1.354913437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:40:41.353568575 +0000 UTC m=+284.763227527" watchObservedRunningTime="2026-08-05 05:40:41.354913437 +0000 UTC m=+284.764572439"
Aug 05 05:40:42.485051 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.485015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:40:42.485388 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.485067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:42.487276 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.487251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40d88b81-cd88-450d-b900-fa18ac50a693-metrics-tls\") pod \"dns-default-htl9b\" (UID: \"40d88b81-cd88-450d-b900-fa18ac50a693\") " pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:42.487461 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.487441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a98b470c-b616-42e8-9672-bac000436b06-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-bz9x2\" (UID: \"a98b470c-b616-42e8-9672-bac000436b06\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:40:42.630691 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.630660    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n4b52\""
Aug 05 05:40:42.630691 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.630660    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vszjg\""
Aug 05 05:40:42.638742 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.638719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:42.638824 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.638792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"
Aug 05 05:40:42.779087 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.779056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htl9b"]
Aug 05 05:40:42.782152 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:40:42.782124    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d88b81_cd88_450d_b900_fa18ac50a693.slice/crio-84dda294edff6df4b3f5aec0ba9c139b0cea3f2e1c1b9c989f157f2b6e73d809 WatchSource:0}: Error finding container 84dda294edff6df4b3f5aec0ba9c139b0cea3f2e1c1b9c989f157f2b6e73d809: Status 404 returned error can't find the container with id 84dda294edff6df4b3f5aec0ba9c139b0cea3f2e1c1b9c989f157f2b6e73d809
Aug 05 05:40:42.795979 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:42.795906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2"]
Aug 05 05:40:42.798387 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:40:42.798364    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98b470c_b616_42e8_9672_bac000436b06.slice/crio-33f4703ea85686fb17e60783af33c7b2a0afc845d248b2860c0334535da7e791 WatchSource:0}: Error finding container 33f4703ea85686fb17e60783af33c7b2a0afc845d248b2860c0334535da7e791: Status 404 returned error can't find the container with id 33f4703ea85686fb17e60783af33c7b2a0afc845d248b2860c0334535da7e791
Aug 05 05:40:43.343707 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:43.343666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2" event={"ID":"a98b470c-b616-42e8-9672-bac000436b06","Type":"ContainerStarted","Data":"33f4703ea85686fb17e60783af33c7b2a0afc845d248b2860c0334535da7e791"}
Aug 05 05:40:43.344715 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:43.344689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htl9b" event={"ID":"40d88b81-cd88-450d-b900-fa18ac50a693","Type":"ContainerStarted","Data":"84dda294edff6df4b3f5aec0ba9c139b0cea3f2e1c1b9c989f157f2b6e73d809"}
Aug 05 05:40:45.356677 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.356645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2" event={"ID":"a98b470c-b616-42e8-9672-bac000436b06","Type":"ContainerStarted","Data":"bc109ac95fd1b785f1f4c81e683bd72bb1bbaccf34ad8f1f615fbe7996aebdd8"}
Aug 05 05:40:45.358440 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.358419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htl9b" event={"ID":"40d88b81-cd88-450d-b900-fa18ac50a693","Type":"ContainerStarted","Data":"9b73122aa0eb7b10c8552945336ee59c277c995fc338d2ac9518e7cb6adb73e7"}
Aug 05 05:40:45.358535 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.358462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htl9b" event={"ID":"40d88b81-cd88-450d-b900-fa18ac50a693","Type":"ContainerStarted","Data":"87002917f0244f86c318208a6b807880bb73cef3a2f4435c47eb6fc856385dfe"}
Aug 05 05:40:45.358535 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.358499    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:45.395007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.394939    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-htl9b" podStartSLOduration=251.62120577 podStartE2EDuration="4m13.394924214s" totalImagesPullingTime="1.773718444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:40:45.393792997 +0000 UTC m=+288.803451945" watchObservedRunningTime="2026-08-05 05:40:45.394924214 +0000 UTC m=+288.804583166"
Aug 05 05:40:45.395615 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:45.395586    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-bz9x2" podStartSLOduration=261.642653504 podStartE2EDuration="4m23.395578748s" totalImagesPullingTime="1.752925244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:40:45.375564301 +0000 UTC m=+288.785223261" watchObservedRunningTime="2026-08-05 05:40:45.395578748 +0000 UTC m=+288.805237697"
Aug 05 05:40:50.353032 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:50.352978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:50.353492 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:50.353067    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:50.357667 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:50.357643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:50.381563 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:50.381544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:40:50.427441 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:50.427406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:40:55.365010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:55.364978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-htl9b"
Aug 05 05:40:57.011268 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:40:57.011245    2581 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 05:41:15.447636 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.447573    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7979c9bc58-h75jw" podUID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" containerName="console" containerID="cri-o://b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755" gracePeriod=15
Aug 05 05:41:15.686891 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.686863    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:41:15.864468 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864483    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9fwq\" (UniqueName: \"kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864600    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.864647 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.864625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle\") pod \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\" (UID: \"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2\") "
Aug 05 05:41:15.865111 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.865065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:41:15.865215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.865098    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config" (OuterVolumeSpecName: "console-config") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:41:15.865215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.865127    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:41:15.865215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.865185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:41:15.866711 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.866681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:41:15.866801 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.866722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:41:15.866801 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.866744    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq" (OuterVolumeSpecName: "kube-api-access-w9fwq") pod "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" (UID: "e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2"). InnerVolumeSpecName "kube-api-access-w9fwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:41:15.966217 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966176    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966217 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966208    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966217 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966217    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966217 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966226    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9fwq\" (UniqueName: \"kubernetes.io/projected/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-kube-api-access-w9fwq\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966479 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966235    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966479 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966244    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:15.966479 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:15.966252    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:41:16.486366 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.486332    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" containerID="b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755" exitCode=0
Aug 05 05:41:16.486829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.486374    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7979c9bc58-h75jw"
Aug 05 05:41:16.486829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.486375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979c9bc58-h75jw" event={"ID":"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2","Type":"ContainerDied","Data":"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"}
Aug 05 05:41:16.486829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.486525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7979c9bc58-h75jw" event={"ID":"e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2","Type":"ContainerDied","Data":"ee845d86e02e8dbcaaddc5db871503f4edbed5fa72bb1b299939c9bb55699f3d"}
Aug 05 05:41:16.486829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.486564    2581 scope.go:117] "RemoveContainer" containerID="b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"
Aug 05 05:41:16.495255 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.495239    2581 scope.go:117] "RemoveContainer" containerID="b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"
Aug 05 05:41:16.495540 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:41:16.495522    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755\": container with ID starting with b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755 not found: ID does not exist" containerID="b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"
Aug 05 05:41:16.495586 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.495548    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755"} err="failed to get container status \"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755\": rpc error: code = NotFound desc = could not find container \"b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755\": container with ID starting with b079d95bee0f17ce2e7babe6c35bf21be55dc27a7e2ee54c2139757d55abd755 not found: ID does not exist"
Aug 05 05:41:16.506247 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.506223    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:41:16.512440 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:16.512420    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7979c9bc58-h75jw"]
Aug 05 05:41:17.240857 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:41:17.240820    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" path="/var/lib/kubelet/pods/e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2/volumes"
Aug 05 05:42:55.607653 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.607617    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:42:55.608261 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.608114    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" containerName="console"
Aug 05 05:42:55.608261 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.608134    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" containerName="console"
Aug 05 05:42:55.608261 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.608224    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8cd1a49-9859-4742-91d5-d1ec3d3eb9f2" containerName="console"
Aug 05 05:42:55.611151 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.611132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:42:55.613340 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.613315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Aug 05 05:42:55.613447 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.613336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-hnzch\""
Aug 05 05:42:55.614058 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.614040    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Aug 05 05:42:55.630008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.629976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:42:55.649732 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.649708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqf4b\" (UniqueName: \"kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b\") pod \"feast-operator-controller-manager-7899b56694-rhmjn\" (UID: \"0cc32324-14e9-4f4a-a8bf-96816ceb7c38\") " pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:42:55.750565 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.750522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqf4b\" (UniqueName: \"kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b\") pod \"feast-operator-controller-manager-7899b56694-rhmjn\" (UID: \"0cc32324-14e9-4f4a-a8bf-96816ceb7c38\") " pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:42:55.759774 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.759738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqf4b\" (UniqueName: \"kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b\") pod \"feast-operator-controller-manager-7899b56694-rhmjn\" (UID: \"0cc32324-14e9-4f4a-a8bf-96816ceb7c38\") " pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:42:55.920680 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:55.920573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:42:56.057539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:56.057506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:42:56.060506 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:42:56.060478    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc32324_14e9_4f4a_a8bf_96816ceb7c38.slice/crio-5945b4ce9aecfcf43edc4c6897997520147348dec4de7da2f7b92b1fa87fac81 WatchSource:0}: Error finding container 5945b4ce9aecfcf43edc4c6897997520147348dec4de7da2f7b92b1fa87fac81: Status 404 returned error can't find the container with id 5945b4ce9aecfcf43edc4c6897997520147348dec4de7da2f7b92b1fa87fac81
Aug 05 05:42:56.062287 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:56.062271    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 05:42:56.853208 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:56.853175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" event={"ID":"0cc32324-14e9-4f4a-a8bf-96816ceb7c38","Type":"ContainerStarted","Data":"5945b4ce9aecfcf43edc4c6897997520147348dec4de7da2f7b92b1fa87fac81"}
Aug 05 05:42:58.862352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:58.862308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" event={"ID":"0cc32324-14e9-4f4a-a8bf-96816ceb7c38","Type":"ContainerStarted","Data":"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"}
Aug 05 05:42:58.862758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:42:58.862449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:43:09.869092 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:09.869062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:43:09.886425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:09.886381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" podStartSLOduration=12.233784966 podStartE2EDuration="14.886354334s" totalImagesPullingTime="2.652569368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:42:58.878144201 +0000 UTC m=+422.287803154" watchObservedRunningTime="2026-08-05 05:43:09.886354334 +0000 UTC m=+433.296013285"
Aug 05 05:43:31.841015 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.840923    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:43:31.844872 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.844853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.847351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Aug 05 05:43:31.847351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847158    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Aug 05 05:43:31.847351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847309    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Aug 05 05:43:31.847588 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Aug 05 05:43:31.847588 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847539    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Aug 05 05:43:31.847833 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Aug 05 05:43:31.848081 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847837    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Aug 05 05:43:31.848203 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.847976    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tfgjc\""
Aug 05 05:43:31.858575 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.858505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:43:31.945706 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.945706 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.945911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4r6\" (UniqueName: \"kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.945911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.945911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:31.945911 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:31.945866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046349 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046349 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046550 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4r6\" (UniqueName: \"kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046550 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046550 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046550 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.046550 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:43:32.046485    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:43:32.046792 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:43:32.046570    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls podName:728efb86-8434-4f4c-9087-518690f32ca8 nodeName:}" failed. No retries permitted until 2026-08-05 05:43:32.546548865 +0000 UTC m=+455.956207803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls") pod "feast-simple-feast-setup-68cf6b8558-rtgjd" (UID: "728efb86-8434-4f4c-9087-518690f32ca8") : secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:43:32.046792 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.046762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.049084 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.049055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.049234 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.049065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.049234 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.049108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.054843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.054820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4r6\" (UniqueName: \"kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.551357 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.551328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.553622 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.553600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-rtgjd\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.762851 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.762811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:43:32.896837 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.896806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:43:32.899744 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:43:32.899698    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod728efb86_8434_4f4c_9087_518690f32ca8.slice/crio-d725a925e9adee30b6549d203114f32df73c868abde4ad9df764c2185cd03c3d WatchSource:0}: Error finding container d725a925e9adee30b6549d203114f32df73c868abde4ad9df764c2185cd03c3d: Status 404 returned error can't find the container with id d725a925e9adee30b6549d203114f32df73c868abde4ad9df764c2185cd03c3d
Aug 05 05:43:32.992576 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:32.992548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"d725a925e9adee30b6549d203114f32df73c868abde4ad9df764c2185cd03c3d"}
Aug 05 05:43:59.106871 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:43:59.106830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"5887f1ce59bab84c434e8d8c4f396aa97f60f76a786fee607ed255a1c615c662"}
Aug 05 05:44:03.124699 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:03.124663    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="5887f1ce59bab84c434e8d8c4f396aa97f60f76a786fee607ed255a1c615c662" exitCode=0
Aug 05 05:44:03.125110 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:03.124730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"5887f1ce59bab84c434e8d8c4f396aa97f60f76a786fee607ed255a1c615c662"}
Aug 05 05:44:04.131046 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:04.131014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"90775f3d187335dc141dd31f06b6dfad4be0f3f788bd4b26e2170cff57dc6fc2"}
Aug 05 05:44:09.151557 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:09.151477    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="90775f3d187335dc141dd31f06b6dfad4be0f3f788bd4b26e2170cff57dc6fc2" exitCode=0
Aug 05 05:44:09.152017 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:09.151551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"90775f3d187335dc141dd31f06b6dfad4be0f3f788bd4b26e2170cff57dc6fc2"}
Aug 05 05:44:09.161631 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:09.161613    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Aug 05 05:44:10.162387 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:10.162343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"54b00ad4ec31c31b1721b8b718da7251d05d99f054348b89aaf7223331220444"}
Aug 05 05:44:10.162971 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:10.162912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"04067f2586d058385938dc5c74b3cbad1408137912293bde09587d980823b115"}
Aug 05 05:44:10.163106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:10.162995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"e2644786bb74ebd06c6656c829378b845e1585cb165228fc00941f345c7011e7"}
Aug 05 05:44:10.163106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:10.163017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerStarted","Data":"ddae47393f9b32a65c63e9c3eff03b87981d55e6276856f3122798db228a84e9"}
Aug 05 05:44:10.189408 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:10.189336    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podStartSLOduration=13.981098646 podStartE2EDuration="39.189315054s" totalImagesPullingTime="25.208216408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:44:10.186912961 +0000 UTC m=+493.596572067" watchObservedRunningTime="2026-08-05 05:44:10.189315054 +0000 UTC m=+493.598974007"
Aug 05 05:44:11.763435 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.763400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:11.763990 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.763968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:11.764430 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.764404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:11.764545 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.764435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:11.765861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.765818    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Aug 05 05:44:11.765861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.765842    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Aug 05 05:44:11.765861 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.765853    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Aug 05 05:44:11.766107 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:11.765927    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Aug 05 05:44:12.763432 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:12.763384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:12.763432 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:12.763457    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:12.764029 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:12.763557    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:12.764029 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:12.763600    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:14.763396 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:14.763347    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Aug 05 05:44:14.763396 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:14.763372    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Aug 05 05:44:14.764086 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:14.763360    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Aug 05 05:44:14.764086 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:14.763614    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Aug 05 05:44:17.763980 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.763921    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.764345 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.764311    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.764490 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.764477    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.765285 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.765260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.765393 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.765343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.765393 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.765379    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:17.769421 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:17.769402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:18.209445 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:18.209368    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:44:26.396413 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:26.396381    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:44:51.415170 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.415100    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f6c7887b-xwdf6" podUID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" containerName="console" containerID="cri-o://4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef" gracePeriod=15
Aug 05 05:44:51.654569 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.654542    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:44:51.746148 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84vlp\" (UniqueName: \"kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746202    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746226    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746319 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert\") pod \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\" (UID: \"a7b8c23f-ebb5-4d73-9d44-eee6c195065e\") "
Aug 05 05:44:51.746663 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config" (OuterVolumeSpecName: "console-config") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:44:51.746663 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746647    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:44:51.746784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:44:51.746784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.746724    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:44:51.748375 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.748340    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:44:51.748375 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.748364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp" (OuterVolumeSpecName: "kube-api-access-84vlp") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "kube-api-access-84vlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:44:51.748541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.748389    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7b8c23f-ebb5-4d73-9d44-eee6c195065e" (UID: "a7b8c23f-ebb5-4d73-9d44-eee6c195065e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:44:51.846928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846892    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.846928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846921    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84vlp\" (UniqueName: \"kubernetes.io/projected/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-kube-api-access-84vlp\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.846928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846933    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.847176 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846941    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.847176 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846970    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-oauth-serving-cert\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.847176 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846978    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-console-oauth-config\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:51.847176 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:51.846988    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b8c23f-ebb5-4d73-9d44-eee6c195065e-trusted-ca-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:44:52.336368 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.336331    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" containerID="4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef" exitCode=0
Aug 05 05:44:52.336533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.336377    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7887b-xwdf6"
Aug 05 05:44:52.336533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.336411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7887b-xwdf6" event={"ID":"a7b8c23f-ebb5-4d73-9d44-eee6c195065e","Type":"ContainerDied","Data":"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"}
Aug 05 05:44:52.336533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.336461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7887b-xwdf6" event={"ID":"a7b8c23f-ebb5-4d73-9d44-eee6c195065e","Type":"ContainerDied","Data":"31f41b14292d7ae52b10cd590feb7f976f8c3d1e32131cb0dbe8ecb6f48d3a6d"}
Aug 05 05:44:52.336533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.336482    2581 scope.go:117] "RemoveContainer" containerID="4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"
Aug 05 05:44:52.345406 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.345387    2581 scope.go:117] "RemoveContainer" containerID="4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"
Aug 05 05:44:52.345670 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:44:52.345654    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef\": container with ID starting with 4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef not found: ID does not exist" containerID="4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"
Aug 05 05:44:52.345708 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.345678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef"} err="failed to get container status \"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef\": rpc error: code = NotFound desc = could not find container \"4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef\": container with ID starting with 4957b74b6ec046f034a684b5b5201ba896a5cc93466f483a619e864a594894ef not found: ID does not exist"
Aug 05 05:44:52.357299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.357276    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:44:52.361134 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:52.361111    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f6c7887b-xwdf6"]
Aug 05 05:44:53.241123 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:44:53.241091    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" path="/var/lib/kubelet/pods/a7b8c23f-ebb5-4d73-9d44-eee6c195065e/volumes"
Aug 05 05:45:21.094152 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.094114    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:45:21.094779 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.094416    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry" containerID="cri-o://ddae47393f9b32a65c63e9c3eff03b87981d55e6276856f3122798db228a84e9" gracePeriod=30
Aug 05 05:45:21.094967 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.094924    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" containerID="cri-o://54b00ad4ec31c31b1721b8b718da7251d05d99f054348b89aaf7223331220444" gracePeriod=30
Aug 05 05:45:21.095147 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.095072    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline" containerID="cri-o://04067f2586d058385938dc5c74b3cbad1408137912293bde09587d980823b115" gracePeriod=30
Aug 05 05:45:21.095234 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.095160    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" containerID="cri-o://e2644786bb74ebd06c6656c829378b845e1585cb165228fc00941f345c7011e7" gracePeriod=30
Aug 05 05:45:21.386484 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.386388    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:45:21.386972 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.386935    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" containerName="console"
Aug 05 05:45:21.387088 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.386974    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" containerName="console"
Aug 05 05:45:21.387142 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.387096    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b8c23f-ebb5-4d73-9d44-eee6c195065e" containerName="console"
Aug 05 05:45:21.391097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.391070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.393380 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.393344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-c4zv5\""
Aug 05 05:45:21.409231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.409214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:45:21.479603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.479832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.479832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.479832 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.480023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.480023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.479882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xqn\" (UniqueName: \"kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581216 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xqn\" (UniqueName: \"kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581626 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581761 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.581857 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.581763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.581916    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.582011    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls podName:49fc1771-8be7-4290-89f7-08f4ff113a87 nodeName:}" failed. No retries permitted until 2026-08-05 05:45:22.081988885 +0000 UTC m=+565.491647814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls") pod "feast-simple-feast-setup-68cf6b8558-zh68j" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87") : secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.582040    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.582111    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls podName:49fc1771-8be7-4290-89f7-08f4ff113a87 nodeName:}" failed. No retries permitted until 2026-08-05 05:45:22.082092996 +0000 UTC m=+565.491751924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls") pod "feast-simple-feast-setup-68cf6b8558-zh68j" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87") : secret "feast-simple-feast-setup-online-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.582195    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:21.582228    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls podName:49fc1771-8be7-4290-89f7-08f4ff113a87 nodeName:}" failed. No retries permitted until 2026-08-05 05:45:22.082217753 +0000 UTC m=+565.491876685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls") pod "feast-simple-feast-setup-68cf6b8558-zh68j" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87") : secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 05:45:21.582485 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.582442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.584368 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.584332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:21.590813 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:21.590782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xqn\" (UniqueName: \"kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.086037 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.085939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.086037 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.086007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.086037 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.086036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.086307 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:22.086076    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Aug 05 05:45:22.086307 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:45:22.086135    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls podName:49fc1771-8be7-4290-89f7-08f4ff113a87 nodeName:}" failed. No retries permitted until 2026-08-05 05:45:23.086119962 +0000 UTC m=+566.495778888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls") pod "feast-simple-feast-setup-68cf6b8558-zh68j" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87") : secret "feast-simple-feast-setup-online-tls" not found
Aug 05 05:45:22.088523 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.088501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.088523 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.088511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:22.455198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.455118    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="54b00ad4ec31c31b1721b8b718da7251d05d99f054348b89aaf7223331220444" exitCode=0
Aug 05 05:45:22.455198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.455140    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="e2644786bb74ebd06c6656c829378b845e1585cb165228fc00941f345c7011e7" exitCode=0
Aug 05 05:45:22.455198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.455159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"54b00ad4ec31c31b1721b8b718da7251d05d99f054348b89aaf7223331220444"}
Aug 05 05:45:22.455198 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:22.455187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"e2644786bb74ebd06c6656c829378b845e1585cb165228fc00941f345c7011e7"}
Aug 05 05:45:23.093505 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.093471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:23.095808 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.095790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"feast-simple-feast-setup-68cf6b8558-zh68j\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") " pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:23.209351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.209319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:23.343334 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.343299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:45:23.346518 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:45:23.346494    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49fc1771_8be7_4290_89f7_08f4ff113a87.slice/crio-e679a90f38245a36cd3165767a39eff691be4a88adba4aa6037e7ffa852a6dce WatchSource:0}: Error finding container e679a90f38245a36cd3165767a39eff691be4a88adba4aa6037e7ffa852a6dce: Status 404 returned error can't find the container with id e679a90f38245a36cd3165767a39eff691be4a88adba4aa6037e7ffa852a6dce
Aug 05 05:45:23.461237 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.461208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"}
Aug 05 05:45:23.461628 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:23.461251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"e679a90f38245a36cd3165767a39eff691be4a88adba4aa6037e7ffa852a6dce"}
Aug 05 05:45:27.765091 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:27.765039    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Aug 05 05:45:28.206377 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:28.206345    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Aug 05 05:45:28.482373 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:28.482343    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d" exitCode=0
Aug 05 05:45:28.482533 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:28.482422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"}
Aug 05 05:45:29.487686 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:29.487651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"}
Aug 05 05:45:34.509083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:34.509053    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56" exitCode=0
Aug 05 05:45:34.509464 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:34.509129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"}
Aug 05 05:45:35.519231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:35.519189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"}
Aug 05 05:45:35.519700 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:35.519252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"}
Aug 05 05:45:35.519700 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:35.519274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"}
Aug 05 05:45:35.519700 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:35.519293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerStarted","Data":"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"}
Aug 05 05:45:35.546642 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:35.546562    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podStartSLOduration=14.546541193 podStartE2EDuration="14.546541193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:45:35.544544207 +0000 UTC m=+578.954203156" watchObservedRunningTime="2026-08-05 05:45:35.546541193 +0000 UTC m=+578.956200143"
Aug 05 05:45:37.765308 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:37.765264    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Aug 05 05:45:38.206528 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.206419    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Aug 05 05:45:38.210660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.209667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:38.210660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.209720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:38.210660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.209740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:38.210660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.209758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:38.212040 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.211993    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Aug 05 05:45:38.212040 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.212025    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Aug 05 05:45:38.212218 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.212067    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Aug 05 05:45:38.212218 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:38.212034    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Aug 05 05:45:41.210554 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.210519    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.210665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.210778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211343 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.211321    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211409 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.211364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211409 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.211383    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211571 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.211554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.211781 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.211768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.212060 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.212047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.215769 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.215753    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.551781 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.551748    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:41.554937 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:41.554911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:45:47.765665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:47.765619    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Aug 05 05:45:47.766134 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:47.765761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:45:48.207352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:48.207263    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Aug 05 05:45:48.207501 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:48.207378    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:45:51.594071 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.594039    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="04067f2586d058385938dc5c74b3cbad1408137912293bde09587d980823b115" exitCode=137
Aug 05 05:45:51.594071 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.594062    2581 generic.go:356] "Generic (PLEG): container finished" podID="728efb86-8434-4f4c-9087-518690f32ca8" containerID="ddae47393f9b32a65c63e9c3eff03b87981d55e6276856f3122798db228a84e9" exitCode=137
Aug 05 05:45:51.594487 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.594110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"04067f2586d058385938dc5c74b3cbad1408137912293bde09587d980823b115"}
Aug 05 05:45:51.594487 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.594149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"ddae47393f9b32a65c63e9c3eff03b87981d55e6276856f3122798db228a84e9"}
Aug 05 05:45:51.751420 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.751398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:45:51.842782 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.842733    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r4r6\" (UniqueName: \"kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.842808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.842833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.842922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.842999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843243 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.843063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls\") pod \"728efb86-8434-4f4c-9087-518690f32ca8\" (UID: \"728efb86-8434-4f4c-9087-518690f32ca8\") "
Aug 05 05:45:51.843349 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.843319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data" (OuterVolumeSpecName: "feast-data") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:45:51.845302 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.845241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:45:51.845302 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.845266    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:45:51.845460 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.845408    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6" (OuterVolumeSpecName: "kube-api-access-2r4r6") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "kube-api-access-2r4r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:45:51.845646 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.845621    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:45:51.845646 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.845633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls" (OuterVolumeSpecName: "online-tls") pod "728efb86-8434-4f4c-9087-518690f32ca8" (UID: "728efb86-8434-4f4c-9087-518690f32ca8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:45:51.944660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944625    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:51.944660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944651    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r4r6\" (UniqueName: \"kubernetes.io/projected/728efb86-8434-4f4c-9087-518690f32ca8-kube-api-access-2r4r6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:51.944660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944661    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/728efb86-8434-4f4c-9087-518690f32ca8-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:51.944660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944670    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:51.944902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944678    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:51.944902 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:51.944686    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/728efb86-8434-4f4c-9087-518690f32ca8-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:45:52.601452 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.601416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd" event={"ID":"728efb86-8434-4f4c-9087-518690f32ca8","Type":"ContainerDied","Data":"d725a925e9adee30b6549d203114f32df73c868abde4ad9df764c2185cd03c3d"}
Aug 05 05:45:52.601914 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.601467    2581 scope.go:117] "RemoveContainer" containerID="54b00ad4ec31c31b1721b8b718da7251d05d99f054348b89aaf7223331220444"
Aug 05 05:45:52.601914 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.601434    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"
Aug 05 05:45:52.619866 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.619841    2581 scope.go:117] "RemoveContainer" containerID="04067f2586d058385938dc5c74b3cbad1408137912293bde09587d980823b115"
Aug 05 05:45:52.627928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.627909    2581 scope.go:117] "RemoveContainer" containerID="e2644786bb74ebd06c6656c829378b845e1585cb165228fc00941f345c7011e7"
Aug 05 05:45:52.635488 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.635463    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:45:52.636661 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.636647    2581 scope.go:117] "RemoveContainer" containerID="ddae47393f9b32a65c63e9c3eff03b87981d55e6276856f3122798db228a84e9"
Aug 05 05:45:52.640813 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.640791    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-rtgjd"]
Aug 05 05:45:52.645672 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.645655    2581 scope.go:117] "RemoveContainer" containerID="90775f3d187335dc141dd31f06b6dfad4be0f3f788bd4b26e2170cff57dc6fc2"
Aug 05 05:45:52.653764 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:52.653748    2581 scope.go:117] "RemoveContainer" containerID="5887f1ce59bab84c434e8d8c4f396aa97f60f76a786fee607ed255a1c615c662"
Aug 05 05:45:53.241169 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:45:53.241132    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="728efb86-8434-4f4c-9087-518690f32ca8" path="/var/lib/kubelet/pods/728efb86-8434-4f4c-9087-518690f32ca8/volumes"
Aug 05 05:46:43.007525 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007434    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007794    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007809    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007824    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="feast-apply"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007829    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="feast-apply"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007834    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007839    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007851    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007856    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="feast-init"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007884    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="feast-init"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007889    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007894    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007957    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="ui"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007965    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="online"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007971    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="registry"
Aug 05 05:46:43.010167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.007977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="728efb86-8434-4f4c-9087-518690f32ca8" containerName="offline"
Aug 05 05:46:43.011115 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.011095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.013575 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.013511    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Aug 05 05:46:43.013691 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.013595    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Aug 05 05:46:43.014127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.013982    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-8gp7t\""
Aug 05 05:46:43.014127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.014006    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Aug 05 05:46:43.014127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.014036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Aug 05 05:46:43.014127 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.014062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Aug 05 05:46:43.014380 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.014238    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Aug 05 05:46:43.014466 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.014425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Aug 05 05:46:43.021797 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.021779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:46:43.043300 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.043425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.043425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.043425 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.043546 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.043546 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.043519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6gft\" (UniqueName: \"kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6gft\" (UniqueName: \"kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.144933 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.144857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.145328 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.145300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.145530 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.145510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.147256 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.147236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.147351 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.147275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.147417 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.147397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.152919 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.152900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6gft\" (UniqueName: \"kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft\") pod \"feast-simple-feast-remote-setup-67869f4c8b-fplv6\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.322296 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.322195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:43.456537 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.456511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:46:43.459117 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:46:43.459087    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ab32911_503a_4628_b6f2_ee9a4622920e.slice/crio-21ae2a3c3e133df43a956bbe1e02c64963e96ccfc5d939ce8168b090f7fc7384 WatchSource:0}: Error finding container 21ae2a3c3e133df43a956bbe1e02c64963e96ccfc5d939ce8168b090f7fc7384: Status 404 returned error can't find the container with id 21ae2a3c3e133df43a956bbe1e02c64963e96ccfc5d939ce8168b090f7fc7384
Aug 05 05:46:43.792846 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.792813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"}
Aug 05 05:46:43.793021 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:43.792856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"21ae2a3c3e133df43a956bbe1e02c64963e96ccfc5d939ce8168b090f7fc7384"}
Aug 05 05:46:48.820383 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:48.820346    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerID="298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8" exitCode=0
Aug 05 05:46:48.820811 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:48.820417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"}
Aug 05 05:46:49.825930 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:49.825896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"}
Aug 05 05:46:54.849089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:54.849051    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerID="fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d" exitCode=0
Aug 05 05:46:54.849471 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:54.849127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"}
Aug 05 05:46:55.859244 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:55.859202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"}
Aug 05 05:46:55.859603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:55.859269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"}
Aug 05 05:46:55.859603 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:55.859288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerStarted","Data":"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"}
Aug 05 05:46:55.887538 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:55.887474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podStartSLOduration=13.887449115999999 podStartE2EDuration="13.887449116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:46:55.885892438 +0000 UTC m=+659.295551415" watchObservedRunningTime="2026-08-05 05:46:55.887449116 +0000 UTC m=+659.297108067"
Aug 05 05:46:58.323253 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.323205    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:58.323744 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.323270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:58.323744 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.323287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:46:58.324984 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.324920    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Aug 05 05:46:58.325099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.324971    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Aug 05 05:46:58.325099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:46:58.324984    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Aug 05 05:47:01.323386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.323353    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.323964 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.323927    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.324070 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.323980    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.324278 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.324259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.330420 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.330396    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.890872 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.890832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.890872 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.890872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.891477 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.891456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:47:01.895364 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:47:01.895341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:48:04.217313 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.217277    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:48:04.217884 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.217555    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online" containerID="cri-o://06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a" gracePeriod=30
Aug 05 05:48:04.217884 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.217645    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui" containerID="cri-o://54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0" gracePeriod=30
Aug 05 05:48:04.217884 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.217730    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="offline" containerID="cri-o://009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1" gracePeriod=30
Aug 05 05:48:04.330031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.329997    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:48:04.330534 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.330500    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="registry" containerID="cri-o://2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa" gracePeriod=30
Aug 05 05:48:04.330678 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.330575    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="offline" containerID="cri-o://d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927" gracePeriod=30
Aug 05 05:48:04.330678 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.330614    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui" containerID="cri-o://6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1" gracePeriod=30
Aug 05 05:48:04.330813 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:04.330682    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online" containerID="cri-o://130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714" gracePeriod=30
Aug 05 05:48:05.150049 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.150021    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1" exitCode=0
Aug 05 05:48:05.150049 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.150045    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714" exitCode=0
Aug 05 05:48:05.150206 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.150091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"}
Aug 05 05:48:05.150206 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.150134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"}
Aug 05 05:48:05.152574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.152555    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerID="54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0" exitCode=0
Aug 05 05:48:05.152574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.152572    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerID="06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a" exitCode=0
Aug 05 05:48:05.152702 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.152626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"}
Aug 05 05:48:05.152702 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:05.152657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"}
Aug 05 05:48:11.211749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:11.211702    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Aug 05 05:48:11.324125 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:11.324089    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Aug 05 05:48:11.551915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:11.551876    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Aug 05 05:48:11.891403 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:11.891300    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Aug 05 05:48:21.211676 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:21.211634    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Aug 05 05:48:21.324529 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:21.324489    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Aug 05 05:48:21.552876 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:21.552837    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Aug 05 05:48:21.891276 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:21.891171    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Aug 05 05:48:31.212002 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.211932    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Aug 05 05:48:31.212436 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.212097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:48:31.324179 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.324145    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Aug 05 05:48:31.324330 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.324242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:48:31.552337 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.552302    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Aug 05 05:48:31.552496 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.552419    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:48:31.891888 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.891795    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Aug 05 05:48:31.892096 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:31.891926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:48:34.449633 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.449610    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:48:34.566806 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6gft\" (UniqueName: \"kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.566976 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566818    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.566976 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566851    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.566976 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.566976 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.566976 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.566970    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data\") pod \"8ab32911-503a-4628-b6f2-ee9a4622920e\" (UID: \"8ab32911-503a-4628-b6f2-ee9a4622920e\") "
Aug 05 05:48:34.567461 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.567427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 05:48:34.567619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.567590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data" (OuterVolumeSpecName: "feast-data") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:48:34.569074 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.569044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:34.569159 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.569085    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:34.569159 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.569106    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls" (OuterVolumeSpecName: "online-tls") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:34.569232 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.569156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft" (OuterVolumeSpecName: "kube-api-access-p6gft") pod "8ab32911-503a-4628-b6f2-ee9a4622920e" (UID: "8ab32911-503a-4628-b6f2-ee9a4622920e"). InnerVolumeSpecName "kube-api-access-p6gft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:48:34.668323 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668293    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8ab32911-503a-4628-b6f2-ee9a4622920e-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.668323 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668320    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.668323 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668329    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.668521 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668338    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ab32911-503a-4628-b6f2-ee9a4622920e-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.668521 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668345    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ab32911-503a-4628-b6f2-ee9a4622920e-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.668521 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.668352    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6gft\" (UniqueName: \"kubernetes.io/projected/8ab32911-503a-4628-b6f2-ee9a4622920e-kube-api-access-p6gft\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:34.970577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:34.970547    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:48:35.071411 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.071411 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.071590 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.071590 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24xqn\" (UniqueName: \"kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.071590 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.071726 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.071590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") pod \"49fc1771-8be7-4290-89f7-08f4ff113a87\" (UID: \"49fc1771-8be7-4290-89f7-08f4ff113a87\") "
Aug 05 05:48:35.072093 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.072060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data" (OuterVolumeSpecName: "feast-data") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:48:35.073539 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.073508    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:35.073666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.073565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls" (OuterVolumeSpecName: "online-tls") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:35.073666 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.073637    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn" (OuterVolumeSpecName: "kube-api-access-24xqn") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "kube-api-access-24xqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:48:35.073896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.073873    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:35.074000 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.073911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49fc1771-8be7-4290-89f7-08f4ff113a87" (UID: "49fc1771-8be7-4290-89f7-08f4ff113a87"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172409    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49fc1771-8be7-4290-89f7-08f4ff113a87-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172427    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24xqn\" (UniqueName: \"kubernetes.io/projected/49fc1771-8be7-4290-89f7-08f4ff113a87-kube-api-access-24xqn\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172436    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172445    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172453    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.172457 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.172460    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49fc1771-8be7-4290-89f7-08f4ff113a87-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:48:35.266097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266073    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927" exitCode=137
Aug 05 05:48:35.266097 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266094    2581 generic.go:356] "Generic (PLEG): container finished" podID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerID="2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa" exitCode=137
Aug 05 05:48:35.266233 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266127    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"
Aug 05 05:48:35.266233 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"}
Aug 05 05:48:35.266233 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"}
Aug 05 05:48:35.266233 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j" event={"ID":"49fc1771-8be7-4290-89f7-08f4ff113a87","Type":"ContainerDied","Data":"e679a90f38245a36cd3165767a39eff691be4a88adba4aa6037e7ffa852a6dce"}
Aug 05 05:48:35.266233 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.266228    2581 scope.go:117] "RemoveContainer" containerID="6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"
Aug 05 05:48:35.268919 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.268899    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerID="009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1" exitCode=137
Aug 05 05:48:35.269023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.268980    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"
Aug 05 05:48:35.269023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.268983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"}
Aug 05 05:48:35.269023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.269019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6" event={"ID":"8ab32911-503a-4628-b6f2-ee9a4622920e","Type":"ContainerDied","Data":"21ae2a3c3e133df43a956bbe1e02c64963e96ccfc5d939ce8168b090f7fc7384"}
Aug 05 05:48:35.275482 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.275468    2581 scope.go:117] "RemoveContainer" containerID="d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"
Aug 05 05:48:35.282522 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.282506    2581 scope.go:117] "RemoveContainer" containerID="130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"
Aug 05 05:48:35.289183 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.289164    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:48:35.289853 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.289823    2581 scope.go:117] "RemoveContainer" containerID="2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"
Aug 05 05:48:35.294059 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.294040    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-68cf6b8558-zh68j"]
Aug 05 05:48:35.299408 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.299387    2581 scope.go:117] "RemoveContainer" containerID="d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"
Aug 05 05:48:35.305606 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.305586    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:48:35.306658 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.306644    2581 scope.go:117] "RemoveContainer" containerID="df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"
Aug 05 05:48:35.309908 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.309890    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67869f4c8b-fplv6"]
Aug 05 05:48:35.313794 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.313778    2581 scope.go:117] "RemoveContainer" containerID="6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"
Aug 05 05:48:35.314050 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.314033    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1\": container with ID starting with 6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1 not found: ID does not exist" containerID="6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"
Aug 05 05:48:35.314102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314055    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"} err="failed to get container status \"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1\": rpc error: code = NotFound desc = could not find container \"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1\": container with ID starting with 6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1 not found: ID does not exist"
Aug 05 05:48:35.314102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314077    2581 scope.go:117] "RemoveContainer" containerID="d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"
Aug 05 05:48:35.314274 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.314260    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927\": container with ID starting with d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927 not found: ID does not exist" containerID="d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"
Aug 05 05:48:35.314316 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314276    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"} err="failed to get container status \"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927\": rpc error: code = NotFound desc = could not find container \"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927\": container with ID starting with d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927 not found: ID does not exist"
Aug 05 05:48:35.314316 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314289    2581 scope.go:117] "RemoveContainer" containerID="130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"
Aug 05 05:48:35.314518 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.314499    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714\": container with ID starting with 130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714 not found: ID does not exist" containerID="130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"
Aug 05 05:48:35.314567 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314524    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"} err="failed to get container status \"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714\": rpc error: code = NotFound desc = could not find container \"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714\": container with ID starting with 130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714 not found: ID does not exist"
Aug 05 05:48:35.314567 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314540    2581 scope.go:117] "RemoveContainer" containerID="2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"
Aug 05 05:48:35.314750 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.314735    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa\": container with ID starting with 2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa not found: ID does not exist" containerID="2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"
Aug 05 05:48:35.314789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314753    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"} err="failed to get container status \"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa\": rpc error: code = NotFound desc = could not find container \"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa\": container with ID starting with 2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa not found: ID does not exist"
Aug 05 05:48:35.314789 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314765    2581 scope.go:117] "RemoveContainer" containerID="d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"
Aug 05 05:48:35.314962 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.314935    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56\": container with ID starting with d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56 not found: ID does not exist" containerID="d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"
Aug 05 05:48:35.315008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314970    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"} err="failed to get container status \"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56\": rpc error: code = NotFound desc = could not find container \"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56\": container with ID starting with d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56 not found: ID does not exist"
Aug 05 05:48:35.315008 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.314987    2581 scope.go:117] "RemoveContainer" containerID="df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"
Aug 05 05:48:35.315248 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.315231    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d\": container with ID starting with df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d not found: ID does not exist" containerID="df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"
Aug 05 05:48:35.315295 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315251    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"} err="failed to get container status \"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d\": rpc error: code = NotFound desc = could not find container \"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d\": container with ID starting with df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d not found: ID does not exist"
Aug 05 05:48:35.315295 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315263    2581 scope.go:117] "RemoveContainer" containerID="6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"
Aug 05 05:48:35.315496 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315478    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1"} err="failed to get container status \"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1\": rpc error: code = NotFound desc = could not find container \"6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1\": container with ID starting with 6a5983c96f3b45244e4d1622f5530ca771d3c8c7d9f0572a8943ec05da9329f1 not found: ID does not exist"
Aug 05 05:48:35.315544 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315497    2581 scope.go:117] "RemoveContainer" containerID="d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"
Aug 05 05:48:35.315689 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315674    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927"} err="failed to get container status \"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927\": rpc error: code = NotFound desc = could not find container \"d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927\": container with ID starting with d6d38da68a535c6dc293abb0a1c78878d03731032724a7a936518a86136aa927 not found: ID does not exist"
Aug 05 05:48:35.315739 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315688    2581 scope.go:117] "RemoveContainer" containerID="130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"
Aug 05 05:48:35.315865 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315850    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714"} err="failed to get container status \"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714\": rpc error: code = NotFound desc = could not find container \"130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714\": container with ID starting with 130a7ab9fb609a170e9e1b3d56c9b74488a5e20e051defbed0349814d769e714 not found: ID does not exist"
Aug 05 05:48:35.315955 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.315865    2581 scope.go:117] "RemoveContainer" containerID="2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"
Aug 05 05:48:35.316083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316066    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa"} err="failed to get container status \"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa\": rpc error: code = NotFound desc = could not find container \"2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa\": container with ID starting with 2ae295ad167ece76b492c91ee8bc6ef5192f5deeba244733354fac8d476dc1aa not found: ID does not exist"
Aug 05 05:48:35.316083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316081    2581 scope.go:117] "RemoveContainer" containerID="d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"
Aug 05 05:48:35.316286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316258    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56"} err="failed to get container status \"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56\": rpc error: code = NotFound desc = could not find container \"d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56\": container with ID starting with d0b50fdf520989c1c39d0dc3ebdf2318991943ff3a67a20ce1eb4c3c7aec0e56 not found: ID does not exist"
Aug 05 05:48:35.316286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316278    2581 scope.go:117] "RemoveContainer" containerID="df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"
Aug 05 05:48:35.316502 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316485    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d"} err="failed to get container status \"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d\": rpc error: code = NotFound desc = could not find container \"df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d\": container with ID starting with df47e80955049caf4078f1a91a8b05259213cda0607dbcf65cd7e7528ab5f50d not found: ID does not exist"
Aug 05 05:48:35.316564 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.316504    2581 scope.go:117] "RemoveContainer" containerID="54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"
Aug 05 05:48:35.323408 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.323394    2581 scope.go:117] "RemoveContainer" containerID="009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"
Aug 05 05:48:35.330337 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.330322    2581 scope.go:117] "RemoveContainer" containerID="06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"
Aug 05 05:48:35.337230 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.337210    2581 scope.go:117] "RemoveContainer" containerID="fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"
Aug 05 05:48:35.343696 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.343682    2581 scope.go:117] "RemoveContainer" containerID="298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"
Aug 05 05:48:35.350271 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.350255    2581 scope.go:117] "RemoveContainer" containerID="54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"
Aug 05 05:48:35.350527 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.350508    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0\": container with ID starting with 54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0 not found: ID does not exist" containerID="54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"
Aug 05 05:48:35.350574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.350532    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0"} err="failed to get container status \"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0\": rpc error: code = NotFound desc = could not find container \"54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0\": container with ID starting with 54b7e31c45a89cb7f6160fbc0b00782f33e1ca9738122134f903a886ea75c9b0 not found: ID does not exist"
Aug 05 05:48:35.350574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.350547    2581 scope.go:117] "RemoveContainer" containerID="009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"
Aug 05 05:48:35.350792 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.350775    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1\": container with ID starting with 009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1 not found: ID does not exist" containerID="009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"
Aug 05 05:48:35.350829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.350800    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1"} err="failed to get container status \"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1\": rpc error: code = NotFound desc = could not find container \"009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1\": container with ID starting with 009ac80f77874c596e9447f5f634415c3b450db8224ff863e94065a27c1d62a1 not found: ID does not exist"
Aug 05 05:48:35.350829 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.350814    2581 scope.go:117] "RemoveContainer" containerID="06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"
Aug 05 05:48:35.351073 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.351056    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a\": container with ID starting with 06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a not found: ID does not exist" containerID="06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"
Aug 05 05:48:35.351130 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.351074    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a"} err="failed to get container status \"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a\": rpc error: code = NotFound desc = could not find container \"06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a\": container with ID starting with 06ecb780b502eaa78dc562b60cff1e967ada48cd260e49935ff43da963509c5a not found: ID does not exist"
Aug 05 05:48:35.351130 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.351086    2581 scope.go:117] "RemoveContainer" containerID="fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"
Aug 05 05:48:35.351286 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.351272    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d\": container with ID starting with fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d not found: ID does not exist" containerID="fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"
Aug 05 05:48:35.351326 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.351287    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d"} err="failed to get container status \"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d\": rpc error: code = NotFound desc = could not find container \"fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d\": container with ID starting with fd3393d88a12837a8a38c3df022fa97921813e34176946a7bd8d671d8271483d not found: ID does not exist"
Aug 05 05:48:35.351326 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.351298    2581 scope.go:117] "RemoveContainer" containerID="298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"
Aug 05 05:48:35.351492 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:35.351478    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8\": container with ID starting with 298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8 not found: ID does not exist" containerID="298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"
Aug 05 05:48:35.351541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:35.351492    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8"} err="failed to get container status \"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8\": rpc error: code = NotFound desc = could not find container \"298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8\": container with ID starting with 298cf8dda8aef3681b93d9bdd3200437900f1fd3c92908ba8d8181a3917156a8 not found: ID does not exist"
Aug 05 05:48:37.240379 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:37.240348    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" path="/var/lib/kubelet/pods/49fc1771-8be7-4290-89f7-08f4ff113a87/volumes"
Aug 05 05:48:37.240939 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:37.240926    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" path="/var/lib/kubelet/pods/8ab32911-503a-4628-b6f2-ee9a4622920e/volumes"
Aug 05 05:48:47.557812 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.557780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558071    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="feast-init"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558082    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="feast-init"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558098    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558104    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558109    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558115    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558120    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558134    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558138    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558145    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="registry"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558150    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="registry"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558156    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="offline"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558160    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="offline"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558168    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="feast-init"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558172    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="feast-init"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558180    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="feast-apply"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558185    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="feast-apply"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558190    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="feast-apply"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558195    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="feast-apply"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558202    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="offline"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558207    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="offline"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558269    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="online"
Aug 05 05:48:47.558262 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558275    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="online"
Aug 05 05:48:47.559033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558282    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="ui"
Aug 05 05:48:47.559033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558288    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="ui"
Aug 05 05:48:47.559033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558294    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab32911-503a-4628-b6f2-ee9a4622920e" containerName="offline"
Aug 05 05:48:47.559033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558301    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="offline"
Aug 05 05:48:47.559033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.558306    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49fc1771-8be7-4290-89f7-08f4ff113a87" containerName="registry"
Aug 05 05:48:47.562353 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.562334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.568093 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.568074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Aug 05 05:48:47.568787 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.568712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-7ksxm\""
Aug 05 05:48:47.568984 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.568965    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Aug 05 05:48:47.569161 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.569143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Aug 05 05:48:47.574877 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.574853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:48:47.662867 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.662831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5khz\" (UniqueName: \"kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.662867 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.662869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.764204 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.764168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.764339 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.764257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5khz\" (UniqueName: \"kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.764486 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.764469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.773594 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.773567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5khz\" (UniqueName: \"kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz\") pod \"postgres-864846d4f5-hgpft\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") " pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:47.878818 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:47.878738    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:48:48.003639 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:48.003610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:48:48.007059 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:48:48.007026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff1a2ab1_ba60_48d4_afb6_4789bda4b9ce.slice/crio-30856bf694ea669446bcd05eab23d20bbcfaf64d0045dbdb7d6dab08430703e0 WatchSource:0}: Error finding container 30856bf694ea669446bcd05eab23d20bbcfaf64d0045dbdb7d6dab08430703e0: Status 404 returned error can't find the container with id 30856bf694ea669446bcd05eab23d20bbcfaf64d0045dbdb7d6dab08430703e0
Aug 05 05:48:48.009151 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:48.009131    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 05:48:48.318359 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:48.318324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-hgpft" event={"ID":"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce","Type":"ContainerStarted","Data":"30856bf694ea669446bcd05eab23d20bbcfaf64d0045dbdb7d6dab08430703e0"}
Aug 05 05:48:54.344250 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:54.344212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-hgpft" event={"ID":"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce","Type":"ContainerStarted","Data":"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"}
Aug 05 05:48:54.360222 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:54.360172    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-hgpft" podStartSLOduration=2.00733999 podStartE2EDuration="7.360156949s" totalImagesPullingTime="5.352816959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:48:54.359899597 +0000 UTC m=+777.769558571" watchObservedRunningTime="2026-08-05 05:48:54.360156949 +0000 UTC m=+777.769815896"
Aug 05 05:48:58.222537 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.222499    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:48:58.229652 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.229631    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.232141 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.232116    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Aug 05 05:48:58.232477 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.232455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Aug 05 05:48:58.232577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.232483    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Aug 05 05:48:58.232577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.232494    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-qkl7x\""
Aug 05 05:48:58.232755 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.232741    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Aug 05 05:48:58.239429 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.239404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:48:58.350580 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.350542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67x9t\" (UniqueName: \"kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.350745 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.350592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.350745 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.350682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.350745 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.350724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.350907 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.350822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.451928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.451890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.451928 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.451939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.452240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.452025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.452240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.452057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67x9t\" (UniqueName: \"kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.452240 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.452089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.452240 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:58.452170    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Aug 05 05:48:58.452454 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:48:58.452265    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls podName:4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18 nodeName:}" failed. No retries permitted until 2026-08-05 05:48:58.952241658 +0000 UTC m=+782.361900605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls") pod "feast-credit-scoring-79bf947467-sgk6n" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18") : secret "feast-credit-scoring-offline-tls" not found
Aug 05 05:48:58.452454 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.452431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.454447 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.454424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.454604 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.454585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.462502 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.462478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67x9t\" (UniqueName: \"kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.956410 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.956375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:58.958765 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:58.958740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") pod \"feast-credit-scoring-79bf947467-sgk6n\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") " pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:59.141293 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:59.141262    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:48:59.275246 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:59.275222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:48:59.276873 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:48:59.276846    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef4407c_6ad3_4bfa_8aa6_b040ae5b7b18.slice/crio-9ccbe0d7a0f8b91dfe430855081c160f142520e09310ce66f753dd9703d7e01c WatchSource:0}: Error finding container 9ccbe0d7a0f8b91dfe430855081c160f142520e09310ce66f753dd9703d7e01c: Status 404 returned error can't find the container with id 9ccbe0d7a0f8b91dfe430855081c160f142520e09310ce66f753dd9703d7e01c
Aug 05 05:48:59.364297 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:59.364269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"f835db6d2fafb39f6f023ec44eeaf6da77288a619b8dae7a0f0fb2243a9254e0"}
Aug 05 05:48:59.364443 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:48:59.364323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"9ccbe0d7a0f8b91dfe430855081c160f142520e09310ce66f753dd9703d7e01c"}
Aug 05 05:49:00.370224 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:00.370196    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerID="f835db6d2fafb39f6f023ec44eeaf6da77288a619b8dae7a0f0fb2243a9254e0" exitCode=0
Aug 05 05:49:00.370607 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:00.370280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"f835db6d2fafb39f6f023ec44eeaf6da77288a619b8dae7a0f0fb2243a9254e0"}
Aug 05 05:49:01.376536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:01.376488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"00144379fb69b33576f2135187862dd3516d4181db8309476c523d5af50bfb80"}
Aug 05 05:49:07.400116 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:07.400084    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerID="00144379fb69b33576f2135187862dd3516d4181db8309476c523d5af50bfb80" exitCode=0
Aug 05 05:49:07.400116 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:07.400120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"00144379fb69b33576f2135187862dd3516d4181db8309476c523d5af50bfb80"}
Aug 05 05:49:08.408264 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:08.408226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"76bf931ce065a9a09bcc97d455587fb6ec12e1408b47f4c222c4a871a2eed463"}
Aug 05 05:49:08.408759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:08.408316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"cc6c64a95650fc8c1003c35f01ea705eef374220fbfec277f58071fda9e60e8f"}
Aug 05 05:49:08.408759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:08.408336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerStarted","Data":"d9740937383e5c294a5bd95a57746cca800430b20c5cf1725a407b527b210f24"}
Aug 05 05:49:08.446379 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:08.446313    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podStartSLOduration=10.446291205 podStartE2EDuration="10.446291205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:49:08.445474433 +0000 UTC m=+791.855133385" watchObservedRunningTime="2026-08-05 05:49:08.446291205 +0000 UTC m=+791.855950154"
Aug 05 05:49:09.141659 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:09.141618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:09.141803 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:09.141702    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:09.141803 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:09.141729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:11.141670 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.141631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:11.142286 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.142259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:11.142400 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.142304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:11.143508 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.143479    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Aug 05 05:49:11.143619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.143519    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Aug 05 05:49:11.143619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:11.143519    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Aug 05 05:49:14.141703 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:14.141659    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Aug 05 05:49:14.142754 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:14.142729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:14.143677 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:14.143657    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:14.148102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:14.148040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:14.439993 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:14.439896    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:17.142596 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:17.142557    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Aug 05 05:49:20.142881 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:20.142805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:49:20.143613 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:49:20.143595    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:50:23.752765 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.752724    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:50:23.753299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.752959    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry" containerID="cri-o://d9740937383e5c294a5bd95a57746cca800430b20c5cf1725a407b527b210f24" gracePeriod=30
Aug 05 05:50:23.753299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.753007    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline" containerID="cri-o://76bf931ce065a9a09bcc97d455587fb6ec12e1408b47f4c222c4a871a2eed463" gracePeriod=30
Aug 05 05:50:23.753299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.753037    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online" containerID="cri-o://cc6c64a95650fc8c1003c35f01ea705eef374220fbfec277f58071fda9e60e8f" gracePeriod=30
Aug 05 05:50:23.770290 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.770264    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:50:23.770430 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:23.770412    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-hgpft" podUID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" containerName="postgres" containerID="cri-o://a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c" gracePeriod=30
Aug 05 05:50:24.008480 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.008420    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:50:24.065903 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.065874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5khz\" (UniqueName: \"kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz\") pod \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") "
Aug 05 05:50:24.065903 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.065913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata\") pod \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\" (UID: \"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce\") "
Aug 05 05:50:24.068063 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.068028    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz" (OuterVolumeSpecName: "kube-api-access-x5khz") pod "ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" (UID: "ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce"). InnerVolumeSpecName "kube-api-access-x5khz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:50:24.096598 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.096561    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" (UID: "ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:50:24.166865 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.166833    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5khz\" (UniqueName: \"kubernetes.io/projected/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-kube-api-access-x5khz\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:24.166865 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.166860    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce-postgresdata\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:24.436745 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.436715    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Aug 05 05:50:24.723795 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.723734    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerID="cc6c64a95650fc8c1003c35f01ea705eef374220fbfec277f58071fda9e60e8f" exitCode=0
Aug 05 05:50:24.724063 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.723804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"cc6c64a95650fc8c1003c35f01ea705eef374220fbfec277f58071fda9e60e8f"}
Aug 05 05:50:24.724990 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.724967    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" containerID="a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c" exitCode=0
Aug 05 05:50:24.725089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.725010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-hgpft" event={"ID":"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce","Type":"ContainerDied","Data":"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"}
Aug 05 05:50:24.725089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.725033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-hgpft" event={"ID":"ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce","Type":"ContainerDied","Data":"30856bf694ea669446bcd05eab23d20bbcfaf64d0045dbdb7d6dab08430703e0"}
Aug 05 05:50:24.725089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.725049    2581 scope.go:117] "RemoveContainer" containerID="a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"
Aug 05 05:50:24.725089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.725062    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-hgpft"
Aug 05 05:50:24.733159 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.733143    2581 scope.go:117] "RemoveContainer" containerID="a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"
Aug 05 05:50:24.733411 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:50:24.733394    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c\": container with ID starting with a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c not found: ID does not exist" containerID="a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"
Aug 05 05:50:24.733484 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.733416    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c"} err="failed to get container status \"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c\": rpc error: code = NotFound desc = could not find container \"a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c\": container with ID starting with a0c97b40193600764f61efba27947b791caadc9087a7eb713ebdbe0aa6dd037c not found: ID does not exist"
Aug 05 05:50:24.745007 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.744986    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:50:24.748434 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:24.748414    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-hgpft"]
Aug 05 05:50:25.240690 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:25.240662    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" path="/var/lib/kubelet/pods/ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce/volumes"
Aug 05 05:50:34.437360 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:34.437314    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Aug 05 05:50:44.437483 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:44.437437    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Aug 05 05:50:44.438001 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:44.437564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:50:53.836618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:53.836589    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerID="76bf931ce065a9a09bcc97d455587fb6ec12e1408b47f4c222c4a871a2eed463" exitCode=137
Aug 05 05:50:53.836618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:53.836616    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerID="d9740937383e5c294a5bd95a57746cca800430b20c5cf1725a407b527b210f24" exitCode=137
Aug 05 05:50:53.836978 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:53.836657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"76bf931ce065a9a09bcc97d455587fb6ec12e1408b47f4c222c4a871a2eed463"}
Aug 05 05:50:53.836978 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:53.836714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"d9740937383e5c294a5bd95a57746cca800430b20c5cf1725a407b527b210f24"}
Aug 05 05:50:54.144273 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.144183    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Aug 05 05:50:54.398784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.398727    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:50:54.517543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.517511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls\") pod \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") "
Aug 05 05:50:54.517716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.517564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data\") pod \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") "
Aug 05 05:50:54.517716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.517598    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls\") pod \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") "
Aug 05 05:50:54.517716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.517644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") pod \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") "
Aug 05 05:50:54.517716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.517680    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67x9t\" (UniqueName: \"kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t\") pod \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\" (UID: \"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18\") "
Aug 05 05:50:54.519566 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.519538    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls" (OuterVolumeSpecName: "online-tls") pod "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:50:54.519744 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.519718    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:50:54.519840 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.519816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t" (OuterVolumeSpecName: "kube-api-access-67x9t") pod "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18"). InnerVolumeSpecName "kube-api-access-67x9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:50:54.519989 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.519941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:50:54.526633 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.526611    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data" (OuterVolumeSpecName: "feast-data") pod "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" (UID: "4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:50:54.624035 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.619802    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:54.624035 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.619854    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:54.624035 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.619870    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:54.624035 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.619883    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:54.624035 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.619901    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67x9t\" (UniqueName: \"kubernetes.io/projected/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18-kube-api-access-67x9t\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:50:54.843418 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.843385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n" event={"ID":"4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18","Type":"ContainerDied","Data":"9ccbe0d7a0f8b91dfe430855081c160f142520e09310ce66f753dd9703d7e01c"}
Aug 05 05:50:54.843782 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.843457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"
Aug 05 05:50:54.843782 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.843475    2581 scope.go:117] "RemoveContainer" containerID="76bf931ce065a9a09bcc97d455587fb6ec12e1408b47f4c222c4a871a2eed463"
Aug 05 05:50:54.852083 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.852065    2581 scope.go:117] "RemoveContainer" containerID="cc6c64a95650fc8c1003c35f01ea705eef374220fbfec277f58071fda9e60e8f"
Aug 05 05:50:54.859541 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.859521    2581 scope.go:117] "RemoveContainer" containerID="d9740937383e5c294a5bd95a57746cca800430b20c5cf1725a407b527b210f24"
Aug 05 05:50:54.865867 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.865848    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:50:54.867245 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.867231    2581 scope.go:117] "RemoveContainer" containerID="00144379fb69b33576f2135187862dd3516d4181db8309476c523d5af50bfb80"
Aug 05 05:50:54.871023 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.870923    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-79bf947467-sgk6n"]
Aug 05 05:50:54.874981 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:54.874963    2581 scope.go:117] "RemoveContainer" containerID="f835db6d2fafb39f6f023ec44eeaf6da77288a619b8dae7a0f0fb2243a9254e0"
Aug 05 05:50:55.240753 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:50:55.240715    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" path="/var/lib/kubelet/pods/4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18/volumes"
Aug 05 05:53:04.115077 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115041    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115399    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" containerName="postgres"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115414    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" containerName="postgres"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115428    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115437    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115448    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115458    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115489    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="feast-init"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115497    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="feast-init"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115506    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115513    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115528    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="feast-apply"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115536    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="feast-apply"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115632    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="online"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115644    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff1a2ab1-ba60-48d4-afb6-4789bda4b9ce" containerName="postgres"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115651    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="offline"
Aug 05 05:53:04.117634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.115660    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef4407c-6ad3-4bfa-8aa6-b040ae5b7b18" containerName="registry"
Aug 05 05:53:04.118580 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.118562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.120785 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.120753    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Aug 05 05:53:04.120920 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.120809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Aug 05 05:53:04.121372 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.121356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Aug 05 05:53:04.121488 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.121416    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-7gc8d\""
Aug 05 05:53:04.126736 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.126711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:53:04.201800 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.201769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.201800 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.201812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxvx\" (UniqueName: \"kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.302350 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.302314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxvx\" (UniqueName: \"kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.302564 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.302406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.302811 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.302793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.311847 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.311818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxvx\" (UniqueName: \"kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx\") pod \"postgres-864846d4f5-jw784\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") " pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.443737 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.443651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:53:04.571657 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:04.571626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:53:04.574829 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:53:04.574806    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod026a6796_a089_4bc0_aa44_b30379d31ba8.slice/crio-acde47312417ce33512b1c9a1cdf77d26853a18c71e97548aae3c6f7bd7abab0 WatchSource:0}: Error finding container acde47312417ce33512b1c9a1cdf77d26853a18c71e97548aae3c6f7bd7abab0: Status 404 returned error can't find the container with id acde47312417ce33512b1c9a1cdf77d26853a18c71e97548aae3c6f7bd7abab0
Aug 05 05:53:05.322260 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:05.322221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" event={"ID":"026a6796-a089-4bc0-aa44-b30379d31ba8","Type":"ContainerStarted","Data":"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"}
Aug 05 05:53:05.322645 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:05.322268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" event={"ID":"026a6796-a089-4bc0-aa44-b30379d31ba8","Type":"ContainerStarted","Data":"acde47312417ce33512b1c9a1cdf77d26853a18c71e97548aae3c6f7bd7abab0"}
Aug 05 05:53:05.341937 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:05.341880    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" podStartSLOduration=1.34186133 podStartE2EDuration="1.34186133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:53:05.34060564 +0000 UTC m=+1028.750264590" watchObservedRunningTime="2026-08-05 05:53:05.34186133 +0000 UTC m=+1028.751520279"
Aug 05 05:53:09.692705 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.692663    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:53:09.696364 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.696339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.698744 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.698719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Aug 05 05:53:09.698864 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.698788    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Aug 05 05:53:09.699066 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.698993    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Aug 05 05:53:09.699201 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.699095    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-nsp5h\""
Aug 05 05:53:09.708131 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.708109    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:53:09.747167 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.747133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.747299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.747182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.747299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.747206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnnmd\" (UniqueName: \"kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.747299 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.747279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.848693 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.848654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.848693 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.848696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnnmd\" (UniqueName: \"kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.848939 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.848728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.848939 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.848818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.848939 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:53:09.848924    2581 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Aug 05 05:53:09.849149 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:53:09.849026    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls podName:b9de86e5-c568-44ca-ad2d-48e1c1312279 nodeName:}" failed. No retries permitted until 2026-08-05 05:53:10.348994865 +0000 UTC m=+1033.758653808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls") pod "feast-credit-scoring-7474f6496f-wb9jn" (UID: "b9de86e5-c568-44ca-ad2d-48e1c1312279") : secret "feast-credit-scoring-online-tls" not found
Aug 05 05:53:09.849212 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.849141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.851231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.851211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:09.858429 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:09.858407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnnmd\" (UniqueName: \"kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:10.352367 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:10.352335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:10.354784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:10.354762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") pod \"feast-credit-scoring-7474f6496f-wb9jn\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") " pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:10.606041 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:10.605940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:10.741983 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:10.741900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:53:10.744093 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:53:10.744066    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9de86e5_c568_44ca_ad2d_48e1c1312279.slice/crio-8f140b930c0ec8d32e87ef7a3e7b1a29c93c07d530de95d0f453e71ad3528d3f WatchSource:0}: Error finding container 8f140b930c0ec8d32e87ef7a3e7b1a29c93c07d530de95d0f453e71ad3528d3f: Status 404 returned error can't find the container with id 8f140b930c0ec8d32e87ef7a3e7b1a29c93c07d530de95d0f453e71ad3528d3f
Aug 05 05:53:11.347887 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:11.347848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerStarted","Data":"3e9f123543db232c1c07cfb16a684dc4c1d75a3842bb09a603c2bd85a733b5d3"}
Aug 05 05:53:11.347887 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:11.347896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerStarted","Data":"8f140b930c0ec8d32e87ef7a3e7b1a29c93c07d530de95d0f453e71ad3528d3f"}
Aug 05 05:53:12.353281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:12.353249    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerID="3e9f123543db232c1c07cfb16a684dc4c1d75a3842bb09a603c2bd85a733b5d3" exitCode=0
Aug 05 05:53:12.353682 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:12.353344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerDied","Data":"3e9f123543db232c1c07cfb16a684dc4c1d75a3842bb09a603c2bd85a733b5d3"}
Aug 05 05:53:13.359893 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:13.359851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerStarted","Data":"9c42a36ec1dd9fd636fc0e4e17e70887c595e8ccb6dd10e3047f46a36ed87a80"}
Aug 05 05:53:19.387180 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:19.387097    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerID="9c42a36ec1dd9fd636fc0e4e17e70887c595e8ccb6dd10e3047f46a36ed87a80" exitCode=0
Aug 05 05:53:19.387180 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:19.387167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerDied","Data":"9c42a36ec1dd9fd636fc0e4e17e70887c595e8ccb6dd10e3047f46a36ed87a80"}
Aug 05 05:53:20.395328 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:20.395271    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerStarted","Data":"45b3220451fb13e0d9c837d43d946cfdb01a3be0e01adf3fecc221e435c470d3"}
Aug 05 05:53:20.395819 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:20.395337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerStarted","Data":"e7da3f53b4e8954b9eb9b5c6ca88e7e9c51bfc1469db688e122147b2fbeb22f0"}
Aug 05 05:53:20.421274 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:20.421202    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podStartSLOduration=11.421181895 podStartE2EDuration="11.421181895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:53:20.418719375 +0000 UTC m=+1043.828378350" watchObservedRunningTime="2026-08-05 05:53:20.421181895 +0000 UTC m=+1043.830840844"
Aug 05 05:53:20.606705 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:20.606660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:20.606897 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:20.606724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:22.606853 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:22.606813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:22.607333 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:22.606888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:22.608295 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:22.608264    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Aug 05 05:53:22.608295 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:22.608277    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Aug 05 05:53:25.607136 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:25.607087    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Aug 05 05:53:25.613446 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:25.613420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:25.616806 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:25.616774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:28.606827 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:28.606778    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Aug 05 05:53:31.607574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:31.607540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:31.608294 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:31.608277    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:53:35.543689 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.543647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:53:35.547614 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.547589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.549924 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.549889    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Aug 05 05:53:35.550106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.550051    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-5829g\""
Aug 05 05:53:35.550106 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.550077    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Aug 05 05:53:35.550224 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.550132    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Aug 05 05:53:35.559866 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.559842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:53:35.662101 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.662067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.662277 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.662111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.662277 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.662215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.662367 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.662282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2x6j\" (UniqueName: \"kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.763028 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.762996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.763222 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.763049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2x6j\" (UniqueName: \"kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.763222 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.763069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.763222 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.763096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.763222 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:53:35.763214    2581 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Aug 05 05:53:35.763427 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:53:35.763278    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls podName:a56d9d28-bae3-46de-b4a7-cc56f94d41b0 nodeName:}" failed. No retries permitted until 2026-08-05 05:53:36.263258141 +0000 UTC m=+1059.672917074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls") pod "feast-driver-ranking-75bcdd89db-frh4r" (UID: "a56d9d28-bae3-46de-b4a7-cc56f94d41b0") : secret "feast-driver-ranking-online-tls" not found
Aug 05 05:53:35.763427 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.763380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.765487 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.765469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:35.772215 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:35.772191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2x6j\" (UniqueName: \"kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:36.265925 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:36.265888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:36.268231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:36.268212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") pod \"feast-driver-ranking-75bcdd89db-frh4r\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") " pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:36.464112 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:36.464080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:36.593161 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:36.593137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:53:36.595095 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:53:36.595069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56d9d28_bae3_46de_b4a7_cc56f94d41b0.slice/crio-c92612a97072998d27a361ceb6ea6e66bd91b5170016f39292c412060096328b WatchSource:0}: Error finding container c92612a97072998d27a361ceb6ea6e66bd91b5170016f39292c412060096328b: Status 404 returned error can't find the container with id c92612a97072998d27a361ceb6ea6e66bd91b5170016f39292c412060096328b
Aug 05 05:53:37.469821 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:37.469783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerStarted","Data":"1ffd8f463f7b4f5e5966cdb477806e97b22010666114e915ab4ffc131988d549"}
Aug 05 05:53:37.470010 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:37.469986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerStarted","Data":"c92612a97072998d27a361ceb6ea6e66bd91b5170016f39292c412060096328b"}
Aug 05 05:53:41.487523 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:41.487491    2581 generic.go:356] "Generic (PLEG): container finished" podID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerID="1ffd8f463f7b4f5e5966cdb477806e97b22010666114e915ab4ffc131988d549" exitCode=0
Aug 05 05:53:41.487895 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:41.487564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerDied","Data":"1ffd8f463f7b4f5e5966cdb477806e97b22010666114e915ab4ffc131988d549"}
Aug 05 05:53:42.492900 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:42.492864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerStarted","Data":"ddcb0ea2e1dd1897164c5e1681df247492b9956507128b471203dbd380c0a57e"}
Aug 05 05:53:48.521424 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:48.521391    2581 generic.go:356] "Generic (PLEG): container finished" podID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerID="ddcb0ea2e1dd1897164c5e1681df247492b9956507128b471203dbd380c0a57e" exitCode=0
Aug 05 05:53:48.521806 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:48.521465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerDied","Data":"ddcb0ea2e1dd1897164c5e1681df247492b9956507128b471203dbd380c0a57e"}
Aug 05 05:53:49.529021 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:49.528921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerStarted","Data":"deaa01f5d317a5eb1ccfe4e809ce37268b492c159bc7b269e492fabad87747fa"}
Aug 05 05:53:49.529021 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:49.529012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerStarted","Data":"7ec1070443dd5ba32244b2ced7a14d92bb9934a3fe3e01444491852fa5c2ea7e"}
Aug 05 05:53:49.552327 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:49.552249    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podStartSLOduration=14.552226509 podStartE2EDuration="14.552226509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:53:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:53:49.551869427 +0000 UTC m=+1072.961528401" watchObservedRunningTime="2026-08-05 05:53:49.552226509 +0000 UTC m=+1072.961885460"
Aug 05 05:53:51.464716 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:51.464676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:51.465236 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:51.464743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:51.466281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:51.466246    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Aug 05 05:53:51.466281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:51.466269    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Aug 05 05:53:54.465727 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:54.465689    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Aug 05 05:53:54.826028 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:54.825992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:54.826617 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:54.826590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:54.829408 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:54.829379    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:56.465033 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:56.465000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:53:57.464743 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:53:57.464701    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Aug 05 05:54:00.465592 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:54:00.465560    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:54:00.466332 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:54:00.466313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:55:14.061568 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.061534    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:55:14.062068 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.061737    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" podUID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" containerName="manager" containerID="cri-o://49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130" gracePeriod=10
Aug 05 05:55:14.313318 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.313247    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:55:14.362446 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.362409    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqf4b\" (UniqueName: \"kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b\") pod \"0cc32324-14e9-4f4a-a8bf-96816ceb7c38\" (UID: \"0cc32324-14e9-4f4a-a8bf-96816ceb7c38\") "
Aug 05 05:55:14.366561 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.366528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b" (OuterVolumeSpecName: "kube-api-access-hqf4b") pod "0cc32324-14e9-4f4a-a8bf-96816ceb7c38" (UID: "0cc32324-14e9-4f4a-a8bf-96816ceb7c38"). InnerVolumeSpecName "kube-api-access-hqf4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:55:14.391717 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.391687    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:55:14.391996 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.391966    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry" containerID="cri-o://e7da3f53b4e8954b9eb9b5c6ca88e7e9c51bfc1469db688e122147b2fbeb22f0" gracePeriod=30
Aug 05 05:55:14.392204 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.392041    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online" containerID="cri-o://45b3220451fb13e0d9c837d43d946cfdb01a3be0e01adf3fecc221e435c470d3" gracePeriod=30
Aug 05 05:55:14.397592 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.397567    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:55:14.397805 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.397776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry" containerID="cri-o://7ec1070443dd5ba32244b2ced7a14d92bb9934a3fe3e01444491852fa5c2ea7e" gracePeriod=30
Aug 05 05:55:14.397929 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.397813    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" containerID="cri-o://deaa01f5d317a5eb1ccfe4e809ce37268b492c159bc7b269e492fabad87747fa" gracePeriod=30
Aug 05 05:55:14.464055 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.464030    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqf4b\" (UniqueName: \"kubernetes.io/projected/0cc32324-14e9-4f4a-a8bf-96816ceb7c38-kube-api-access-hqf4b\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:14.827698 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.827643    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Aug 05 05:55:14.880848 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.880814    2581 generic.go:356] "Generic (PLEG): container finished" podID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" containerID="49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130" exitCode=0
Aug 05 05:55:14.881082 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.880857    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"
Aug 05 05:55:14.881082 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.880857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" event={"ID":"0cc32324-14e9-4f4a-a8bf-96816ceb7c38","Type":"ContainerDied","Data":"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"}
Aug 05 05:55:14.881082 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.880991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn" event={"ID":"0cc32324-14e9-4f4a-a8bf-96816ceb7c38","Type":"ContainerDied","Data":"5945b4ce9aecfcf43edc4c6897997520147348dec4de7da2f7b92b1fa87fac81"}
Aug 05 05:55:14.881082 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.881026    2581 scope.go:117] "RemoveContainer" containerID="49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"
Aug 05 05:55:14.891531 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.891512    2581 scope.go:117] "RemoveContainer" containerID="49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"
Aug 05 05:55:14.891810 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:55:14.891789    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130\": container with ID starting with 49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130 not found: ID does not exist" containerID="49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"
Aug 05 05:55:14.891869 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.891817    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130"} err="failed to get container status \"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130\": rpc error: code = NotFound desc = could not find container \"49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130\": container with ID starting with 49adfc43dd3e26b5f1587ed76328d160a68995187b0ae5f877551ff086aa4130 not found: ID does not exist"
Aug 05 05:55:14.902282 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.902250    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:55:14.905765 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:14.905739    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7899b56694-rhmjn"]
Aug 05 05:55:15.240670 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.240642    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" path="/var/lib/kubelet/pods/0cc32324-14e9-4f4a-a8bf-96816ceb7c38/volumes"
Aug 05 05:55:15.614784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.614738    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Aug 05 05:55:15.887183 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.887096    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerID="45b3220451fb13e0d9c837d43d946cfdb01a3be0e01adf3fecc221e435c470d3" exitCode=0
Aug 05 05:55:15.887183 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.887169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerDied","Data":"45b3220451fb13e0d9c837d43d946cfdb01a3be0e01adf3fecc221e435c470d3"}
Aug 05 05:55:15.889230 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.889211    2581 generic.go:356] "Generic (PLEG): container finished" podID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerID="deaa01f5d317a5eb1ccfe4e809ce37268b492c159bc7b269e492fabad87747fa" exitCode=0
Aug 05 05:55:15.889347 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:15.889273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerDied","Data":"deaa01f5d317a5eb1ccfe4e809ce37268b492c159bc7b269e492fabad87747fa"}
Aug 05 05:55:16.793031 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:16.792995    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:55:16.793437 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:16.793153    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" podUID="026a6796-a089-4bc0-aa44-b30379d31ba8" containerName="postgres" containerID="cri-o://0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09" gracePeriod=30
Aug 05 05:55:17.029574 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.029547    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:55:17.087123 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.087034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmxvx\" (UniqueName: \"kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx\") pod \"026a6796-a089-4bc0-aa44-b30379d31ba8\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") "
Aug 05 05:55:17.087123 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.087097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata\") pod \"026a6796-a089-4bc0-aa44-b30379d31ba8\" (UID: \"026a6796-a089-4bc0-aa44-b30379d31ba8\") "
Aug 05 05:55:17.089277 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.089232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx" (OuterVolumeSpecName: "kube-api-access-cmxvx") pod "026a6796-a089-4bc0-aa44-b30379d31ba8" (UID: "026a6796-a089-4bc0-aa44-b30379d31ba8"). InnerVolumeSpecName "kube-api-access-cmxvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:55:17.117729 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.117693    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "026a6796-a089-4bc0-aa44-b30379d31ba8" (UID: "026a6796-a089-4bc0-aa44-b30379d31ba8"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:55:17.187778 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.187749    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmxvx\" (UniqueName: \"kubernetes.io/projected/026a6796-a089-4bc0-aa44-b30379d31ba8-kube-api-access-cmxvx\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:17.187778 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.187774    2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/026a6796-a089-4bc0-aa44-b30379d31ba8-postgresdata\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:17.899119 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.899082    2581 generic.go:356] "Generic (PLEG): container finished" podID="026a6796-a089-4bc0-aa44-b30379d31ba8" containerID="0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09" exitCode=0
Aug 05 05:55:17.899119 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.899127    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-jw784"
Aug 05 05:55:17.899570 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.899171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" event={"ID":"026a6796-a089-4bc0-aa44-b30379d31ba8","Type":"ContainerDied","Data":"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"}
Aug 05 05:55:17.899570 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.899217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-jw784" event={"ID":"026a6796-a089-4bc0-aa44-b30379d31ba8","Type":"ContainerDied","Data":"acde47312417ce33512b1c9a1cdf77d26853a18c71e97548aae3c6f7bd7abab0"}
Aug 05 05:55:17.899570 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.899233    2581 scope.go:117] "RemoveContainer" containerID="0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"
Aug 05 05:55:17.907009 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.906994    2581 scope.go:117] "RemoveContainer" containerID="0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"
Aug 05 05:55:17.907234 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:55:17.907214    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09\": container with ID starting with 0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09 not found: ID does not exist" containerID="0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"
Aug 05 05:55:17.907273 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.907243    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09"} err="failed to get container status \"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09\": rpc error: code = NotFound desc = could not find container \"0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09\": container with ID starting with 0ac0880765ec77113b64265d68dfde04954ba4c5f79c530fe5ba24b09afe0b09 not found: ID does not exist"
Aug 05 05:55:17.915316 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.915294    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:55:17.918920 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:17.918899    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-jw784"]
Aug 05 05:55:19.240816 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:19.240784    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026a6796-a089-4bc0-aa44-b30379d31ba8" path="/var/lib/kubelet/pods/026a6796-a089-4bc0-aa44-b30379d31ba8/volumes"
Aug 05 05:55:24.827543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:24.827501    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Aug 05 05:55:25.614380 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:25.614337    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Aug 05 05:55:34.827395 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:34.827348    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Aug 05 05:55:34.827845 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:34.827526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:55:35.614119 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:35.614079    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Aug 05 05:55:35.614296 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:35.614211    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:55:44.827646 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:44.827603    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Aug 05 05:55:45.005826 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.005794    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerID="e7da3f53b4e8954b9eb9b5c6ca88e7e9c51bfc1469db688e122147b2fbeb22f0" exitCode=137
Aug 05 05:55:45.005975 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.005894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerDied","Data":"e7da3f53b4e8954b9eb9b5c6ca88e7e9c51bfc1469db688e122147b2fbeb22f0"}
Aug 05 05:55:45.009074 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.009050    2581 generic.go:356] "Generic (PLEG): container finished" podID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerID="7ec1070443dd5ba32244b2ced7a14d92bb9934a3fe3e01444491852fa5c2ea7e" exitCode=137
Aug 05 05:55:45.009221 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.009126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerDied","Data":"7ec1070443dd5ba32244b2ced7a14d92bb9934a3fe3e01444491852fa5c2ea7e"}
Aug 05 05:55:45.075383 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.075359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:55:45.078231 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.078185    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:55:45.216749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.216712    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls\") pod \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") "
Aug 05 05:55:45.216749 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.216750    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") pod \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") "
Aug 05 05:55:45.217139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.216768    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data\") pod \"b9de86e5-c568-44ca-ad2d-48e1c1312279\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") "
Aug 05 05:55:45.217139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.216784    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data\") pod \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") "
Aug 05 05:55:45.217139 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.216815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnnmd\" (UniqueName: \"kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd\") pod \"b9de86e5-c568-44ca-ad2d-48e1c1312279\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") "
Aug 05 05:55:45.217304 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.217136    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls\") pod \"b9de86e5-c568-44ca-ad2d-48e1c1312279\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") "
Aug 05 05:55:45.217304 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.217230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") pod \"b9de86e5-c568-44ca-ad2d-48e1c1312279\" (UID: \"b9de86e5-c568-44ca-ad2d-48e1c1312279\") "
Aug 05 05:55:45.217407 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.217365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data" (OuterVolumeSpecName: "feast-data") pod "a56d9d28-bae3-46de-b4a7-cc56f94d41b0" (UID: "a56d9d28-bae3-46de-b4a7-cc56f94d41b0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:55:45.217546 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.217526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2x6j\" (UniqueName: \"kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j\") pod \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\" (UID: \"a56d9d28-bae3-46de-b4a7-cc56f94d41b0\") "
Aug 05 05:55:45.217781 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.217762    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.219465 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.219437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls" (OuterVolumeSpecName: "online-tls") pod "a56d9d28-bae3-46de-b4a7-cc56f94d41b0" (UID: "a56d9d28-bae3-46de-b4a7-cc56f94d41b0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:55:45.219702 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.219661    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b9de86e5-c568-44ca-ad2d-48e1c1312279" (UID: "b9de86e5-c568-44ca-ad2d-48e1c1312279"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:55:45.219702 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.219677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd" (OuterVolumeSpecName: "kube-api-access-qnnmd") pod "b9de86e5-c568-44ca-ad2d-48e1c1312279" (UID: "b9de86e5-c568-44ca-ad2d-48e1c1312279"). InnerVolumeSpecName "kube-api-access-qnnmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:55:45.219899 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.219840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a56d9d28-bae3-46de-b4a7-cc56f94d41b0" (UID: "a56d9d28-bae3-46de-b4a7-cc56f94d41b0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:55:45.219899 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.219842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls" (OuterVolumeSpecName: "online-tls") pod "b9de86e5-c568-44ca-ad2d-48e1c1312279" (UID: "b9de86e5-c568-44ca-ad2d-48e1c1312279"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:55:45.220070 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.220049    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j" (OuterVolumeSpecName: "kube-api-access-w2x6j") pod "a56d9d28-bae3-46de-b4a7-cc56f94d41b0" (UID: "a56d9d28-bae3-46de-b4a7-cc56f94d41b0"). InnerVolumeSpecName "kube-api-access-w2x6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:55:45.226168 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.226139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data" (OuterVolumeSpecName: "feast-data") pod "b9de86e5-c568-44ca-ad2d-48e1c1312279" (UID: "b9de86e5-c568-44ca-ad2d-48e1c1312279"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:55:45.318156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318127    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318150    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b9de86e5-c568-44ca-ad2d-48e1c1312279-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318156 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318158    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2x6j\" (UniqueName: \"kubernetes.io/projected/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-kube-api-access-w2x6j\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318166    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318175    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a56d9d28-bae3-46de-b4a7-cc56f94d41b0-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318182    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b9de86e5-c568-44ca-ad2d-48e1c1312279-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:45.318352 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:45.318190    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnnmd\" (UniqueName: \"kubernetes.io/projected/b9de86e5-c568-44ca-ad2d-48e1c1312279-kube-api-access-qnnmd\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:55:46.014896 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.014869    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"
Aug 05 05:55:46.015395 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.014865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn" event={"ID":"b9de86e5-c568-44ca-ad2d-48e1c1312279","Type":"ContainerDied","Data":"8f140b930c0ec8d32e87ef7a3e7b1a29c93c07d530de95d0f453e71ad3528d3f"}
Aug 05 05:55:46.015395 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.015002    2581 scope.go:117] "RemoveContainer" containerID="45b3220451fb13e0d9c837d43d946cfdb01a3be0e01adf3fecc221e435c470d3"
Aug 05 05:55:46.017339 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.017318    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"
Aug 05 05:55:46.017339 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.017323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r" event={"ID":"a56d9d28-bae3-46de-b4a7-cc56f94d41b0","Type":"ContainerDied","Data":"c92612a97072998d27a361ceb6ea6e66bd91b5170016f39292c412060096328b"}
Aug 05 05:55:46.023921 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.023906    2581 scope.go:117] "RemoveContainer" containerID="e7da3f53b4e8954b9eb9b5c6ca88e7e9c51bfc1469db688e122147b2fbeb22f0"
Aug 05 05:55:46.031162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.031123    2581 scope.go:117] "RemoveContainer" containerID="9c42a36ec1dd9fd636fc0e4e17e70887c595e8ccb6dd10e3047f46a36ed87a80"
Aug 05 05:55:46.032736 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.032715    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:55:46.036490 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.036472    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7474f6496f-wb9jn"]
Aug 05 05:55:46.038916 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.038898    2581 scope.go:117] "RemoveContainer" containerID="3e9f123543db232c1c07cfb16a684dc4c1d75a3842bb09a603c2bd85a733b5d3"
Aug 05 05:55:46.045634 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.045608    2581 scope.go:117] "RemoveContainer" containerID="deaa01f5d317a5eb1ccfe4e809ce37268b492c159bc7b269e492fabad87747fa"
Aug 05 05:55:46.052064 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.051501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:55:46.055607 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.055586    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-75bcdd89db-frh4r"]
Aug 05 05:55:46.057848 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.057828    2581 scope.go:117] "RemoveContainer" containerID="7ec1070443dd5ba32244b2ced7a14d92bb9934a3fe3e01444491852fa5c2ea7e"
Aug 05 05:55:46.065390 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.065373    2581 scope.go:117] "RemoveContainer" containerID="ddcb0ea2e1dd1897164c5e1681df247492b9956507128b471203dbd380c0a57e"
Aug 05 05:55:46.072248 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:46.072234    2581 scope.go:117] "RemoveContainer" containerID="1ffd8f463f7b4f5e5966cdb477806e97b22010666114e915ab4ffc131988d549"
Aug 05 05:55:47.241021 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:47.240988    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" path="/var/lib/kubelet/pods/a56d9d28-bae3-46de-b4a7-cc56f94d41b0/volumes"
Aug 05 05:55:47.241476 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:47.241464    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" path="/var/lib/kubelet/pods/b9de86e5-c568-44ca-ad2d-48e1c1312279/volumes"
Aug 05 05:55:50.765329 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765293    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765702    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="feast-init"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765720    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="feast-init"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765733    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765741    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765765    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="feast-apply"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765773    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="feast-apply"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765782    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765790    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765807    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026a6796-a089-4bc0-aa44-b30379d31ba8" containerName="postgres"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765814    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="026a6796-a089-4bc0-aa44-b30379d31ba8" containerName="postgres"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765823    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="feast-init"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765831    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="feast-init"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765841    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" containerName="manager"
Aug 05 05:55:50.765843 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765849    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" containerName="manager"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765861    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765869    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="feast-apply"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765887    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="feast-apply"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765896    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765905    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.765995    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="026a6796-a089-4bc0-aa44-b30379d31ba8" containerName="postgres"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.766008    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="online"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.766018    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="online"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.766026    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9de86e5-c568-44ca-ad2d-48e1c1312279" containerName="registry"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.766038    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc32324-14e9-4f4a-a8bf-96816ceb7c38" containerName="manager"
Aug 05 05:55:50.766536 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.766047    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a56d9d28-bae3-46de-b4a7-cc56f94d41b0" containerName="registry"
Aug 05 05:55:50.772178 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.772156    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.774431 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Aug 05 05:55:50.774553 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774511    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Aug 05 05:55:50.774553 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Aug 05 05:55:50.774703 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Aug 05 05:55:50.774923 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774905    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Aug 05 05:55:50.775089 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.774911    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xgt8g\""
Aug 05 05:55:50.775180 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.775001    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Aug 05 05:55:50.783102 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.782361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:55:50.859327 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.859473 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.859473 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.859589 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.859589 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6ctr\" (UniqueName: \"kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.859691 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.859622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.960871 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.960834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.960882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6ctr\" (UniqueName: \"kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.960911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.960938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.961003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961043 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.961039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.961294 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:55:50.961061    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:55:50.961294 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:55:50.961130    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls podName:1fed7b35-df4b-4ab0-8b22-c664a02521a6 nodeName:}" failed. No retries permitted until 2026-08-05 05:55:51.461110058 +0000 UTC m=+1194.870768984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls") pod "feast-simple-feast-setup-777d6cc998-wv78d" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6") : secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:55:50.961410 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.961378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.963356 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.963328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.963772 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.963754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.963827 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.963807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:50.970200 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:50.970181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6ctr\" (UniqueName: \"kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:51.465058 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:51.465020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:51.467364 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:51.467331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wv78d\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:51.693051 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:51.693011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:55:51.824212 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:51.824178    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:55:51.827042 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:55:51.827011    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fed7b35_df4b_4ab0_8b22_c664a02521a6.slice/crio-fa712771caad6ed252aea1d44b87efb8161c37f4a3c5e83fc04b1434790a7beb WatchSource:0}: Error finding container fa712771caad6ed252aea1d44b87efb8161c37f4a3c5e83fc04b1434790a7beb: Status 404 returned error can't find the container with id fa712771caad6ed252aea1d44b87efb8161c37f4a3c5e83fc04b1434790a7beb
Aug 05 05:55:51.828774 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:51.828759    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 05:55:52.042940 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:55:52.042860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"fa712771caad6ed252aea1d44b87efb8161c37f4a3c5e83fc04b1434790a7beb"}
Aug 05 05:56:06.109770 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:06.109731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"93fb1bdff904de7f0b655b41fd34eaab115a0e1e6c16fd984f4b52028b9d6f41"}
Aug 05 05:56:10.126555 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:10.126510    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="93fb1bdff904de7f0b655b41fd34eaab115a0e1e6c16fd984f4b52028b9d6f41" exitCode=0
Aug 05 05:56:10.127122 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:10.126570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"93fb1bdff904de7f0b655b41fd34eaab115a0e1e6c16fd984f4b52028b9d6f41"}
Aug 05 05:56:11.132022 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:11.131989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"ba46e147c6df9d007592925c103585f99b88ac1e805d3b7bfa2ee2d08f8c6d00"}
Aug 05 05:56:16.153695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:16.153615    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="ba46e147c6df9d007592925c103585f99b88ac1e805d3b7bfa2ee2d08f8c6d00" exitCode=0
Aug 05 05:56:16.153695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:16.153681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"ba46e147c6df9d007592925c103585f99b88ac1e805d3b7bfa2ee2d08f8c6d00"}
Aug 05 05:56:17.163628 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:17.163581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"da6001b2bb936e5fe9dc1e0de69f59c2ee8639a023a2baa49066145305172bee"}
Aug 05 05:56:17.164264 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:17.163651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"823f6a737cf87949c1f212fd1ff93422ae7e02558c5466846861b5006746d0c9"}
Aug 05 05:56:17.164264 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:17.163673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"da7fa2698eee44c0a12e186af09b2b2b58637ad26fc22a384eabdf2e98c43645"}
Aug 05 05:56:17.164264 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:17.163691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerStarted","Data":"661bce8014b7364766f55744a91e69c217783aecf402e196339619c5cae82f51"}
Aug 05 05:56:17.196704 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:17.196627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podStartSLOduration=13.778374542 podStartE2EDuration="27.19660278s" totalImagesPullingTime="13.418228238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:56:17.192851349 +0000 UTC m=+1220.602510319" watchObservedRunningTime="2026-08-05 05:56:17.19660278 +0000 UTC m=+1220.606261731"
Aug 05 05:56:18.693758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.693681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:18.693758 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.693758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:18.694355 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.693778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:18.694355 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.693796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:18.695915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.695818    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Aug 05 05:56:18.695915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.695858    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Aug 05 05:56:18.695915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.695873    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Aug 05 05:56:18.695915 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:18.695865    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Aug 05 05:56:21.694034 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.693990    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:21.694604 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.694582    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:21.694771 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.694266    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Aug 05 05:56:21.695050 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.694447    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Aug 05 05:56:21.695166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.694577    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Aug 05 05:56:21.695166 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.694259    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Aug 05 05:56:21.695290 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.695189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:21.695290 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:21.695222    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.695214 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.695186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.695636 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.695310    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.695636 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.695507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.696203 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.696178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.696318 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.696251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.696318 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.696299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:24.700277 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:24.700258    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:56:25.206183 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:56:25.206149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:57:27.142905 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.142870    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:57:27.143456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.143257    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" containerID="cri-o://da6001b2bb936e5fe9dc1e0de69f59c2ee8639a023a2baa49066145305172bee" gracePeriod=30
Aug 05 05:57:27.143456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.143257    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline" containerID="cri-o://823f6a737cf87949c1f212fd1ff93422ae7e02558c5466846861b5006746d0c9" gracePeriod=30
Aug 05 05:57:27.143456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.143283    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" containerID="cri-o://da7fa2698eee44c0a12e186af09b2b2b58637ad26fc22a384eabdf2e98c43645" gracePeriod=30
Aug 05 05:57:27.143456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.143418    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry" containerID="cri-o://661bce8014b7364766f55744a91e69c217783aecf402e196339619c5cae82f51" gracePeriod=30
Aug 05 05:57:27.434418 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.434337    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 05:57:27.438577 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.438550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.440700 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.440680    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mcxmh\""
Aug 05 05:57:27.449250 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.449220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 05:57:27.539098 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.539360 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.539505 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.539660 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.539804 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.539917 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.539901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnb46\" (UniqueName: \"kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.640925 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.640885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.640938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnb46\" (UniqueName: \"kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.641009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.641036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.641066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641162 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.641117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641442 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.641359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.641498 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:57:27.641464    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 05:57:27.641550 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:57:27.641520    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls podName:e1d22350-080f-4b25-a7b3-2873c5a67308 nodeName:}" failed. No retries permitted until 2026-08-05 05:57:28.141500123 +0000 UTC m=+1291.551159075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls") pod "feast-simple-feast-setup-777d6cc998-rjhtq" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308") : secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 05:57:27.641801 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:57:27.641781    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:57:27.641883 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:57:27.641849    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls podName:e1d22350-080f-4b25-a7b3-2873c5a67308 nodeName:}" failed. No retries permitted until 2026-08-05 05:57:28.14183204 +0000 UTC m=+1291.551490971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls") pod "feast-simple-feast-setup-777d6cc998-rjhtq" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308") : secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 05:57:27.644257 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.644203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.644449 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.644427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:27.652575 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:27.652549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnb46\" (UniqueName: \"kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.146605 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.146575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.146605 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.146609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.148816 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.148792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.148978 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.148836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rjhtq\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.348650 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.348614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:28.445354 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.445322    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="da6001b2bb936e5fe9dc1e0de69f59c2ee8639a023a2baa49066145305172bee" exitCode=0
Aug 05 05:57:28.445354 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.445354    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="da7fa2698eee44c0a12e186af09b2b2b58637ad26fc22a384eabdf2e98c43645" exitCode=0
Aug 05 05:57:28.445532 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.445394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"da6001b2bb936e5fe9dc1e0de69f59c2ee8639a023a2baa49066145305172bee"}
Aug 05 05:57:28.445532 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.445438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"da7fa2698eee44c0a12e186af09b2b2b58637ad26fc22a384eabdf2e98c43645"}
Aug 05 05:57:28.480108 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:28.480087    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 05:57:28.481330 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:57:28.481307    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1d22350_080f_4b25_a7b3_2873c5a67308.slice/crio-53c4a57d78699c1ffa8beb57f812919614be766d2455d395adedaeb8d63c445f WatchSource:0}: Error finding container 53c4a57d78699c1ffa8beb57f812919614be766d2455d395adedaeb8d63c445f: Status 404 returned error can't find the container with id 53c4a57d78699c1ffa8beb57f812919614be766d2455d395adedaeb8d63c445f
Aug 05 05:57:29.450547 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:29.450505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"}
Aug 05 05:57:29.451022 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:29.450565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"53c4a57d78699c1ffa8beb57f812919614be766d2455d395adedaeb8d63c445f"}
Aug 05 05:57:33.466618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:33.466535    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780" exitCode=0
Aug 05 05:57:33.466618 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:33.466605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"}
Aug 05 05:57:34.472217 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:34.472182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"}
Aug 05 05:57:34.696619 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:34.696572    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Aug 05 05:57:35.203562 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:35.203525    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Aug 05 05:57:39.495348 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:39.495316    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a" exitCode=0
Aug 05 05:57:39.495725 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:39.495388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"}
Aug 05 05:57:40.506449 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:40.506407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"}
Aug 05 05:57:40.507067 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:40.506471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"}
Aug 05 05:57:40.507067 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:40.506495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"}
Aug 05 05:57:40.507067 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:40.506514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerStarted","Data":"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"}
Aug 05 05:57:40.531662 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:40.531581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podStartSLOduration=13.531560297 podStartE2EDuration="13.531560297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:57:40.529898801 +0000 UTC m=+1303.939557750" watchObservedRunningTime="2026-08-05 05:57:40.531560297 +0000 UTC m=+1303.941219244"
Aug 05 05:57:43.349871 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.349839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:43.350438 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.350418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:43.350553 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.350542    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:43.350899 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.350886    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:43.352101 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.352062    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Aug 05 05:57:43.352426 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.352110    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Aug 05 05:57:43.352426 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.352074    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Aug 05 05:57:43.352426 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:43.352203    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Aug 05 05:57:44.696386 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:44.696342    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Aug 05 05:57:45.204093 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:45.204047    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Aug 05 05:57:46.350281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.350242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.350737 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.350512    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.350996 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.350978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.351099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.351013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.351099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.351032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.351099 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.351087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.351273 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.351134    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.355413 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.355395    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.540164 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.540117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.540357 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.540183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.543016 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.542987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:46.545715 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:46.545691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 05:57:54.696689 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:54.696633    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Aug 05 05:57:54.697281 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:54.696802    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:57:55.204062 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:55.204018    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Aug 05 05:57:55.204236 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:55.204153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:57:57.583338 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.583307    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="823f6a737cf87949c1f212fd1ff93422ae7e02558c5466846861b5006746d0c9" exitCode=137
Aug 05 05:57:57.583338 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.583329    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerID="661bce8014b7364766f55744a91e69c217783aecf402e196339619c5cae82f51" exitCode=137
Aug 05 05:57:57.583743 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.583351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"823f6a737cf87949c1f212fd1ff93422ae7e02558c5466846861b5006746d0c9"}
Aug 05 05:57:57.583743 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.583388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"661bce8014b7364766f55744a91e69c217783aecf402e196339619c5cae82f51"}
Aug 05 05:57:57.793451 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.793426    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:57:57.908168 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908096    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908168 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908138    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908168 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908366 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908366 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908327    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6ctr\" (UniqueName: \"kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908469 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls\") pod \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\" (UID: \"1fed7b35-df4b-4ab0-8b22-c664a02521a6\") "
Aug 05 05:57:57.908664 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.908633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data" (OuterVolumeSpecName: "feast-data") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 05:57:57.910473 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.910446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:57:57.910667 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.910643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr" (OuterVolumeSpecName: "kube-api-access-g6ctr") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "kube-api-access-g6ctr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 05:57:57.910741 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.910649    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:57:57.910787 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.910762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:57:57.910787 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:57.910776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls" (OuterVolumeSpecName: "online-tls") pod "1fed7b35-df4b-4ab0-8b22-c664a02521a6" (UID: "1fed7b35-df4b-4ab0-8b22-c664a02521a6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 05:57:58.009195 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009159    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.009195 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009190    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1fed7b35-df4b-4ab0-8b22-c664a02521a6-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.009195 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009199    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.009195 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009206    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.009422 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009214    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1fed7b35-df4b-4ab0-8b22-c664a02521a6-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.009422 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.009222    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6ctr\" (UniqueName: \"kubernetes.io/projected/1fed7b35-df4b-4ab0-8b22-c664a02521a6-kube-api-access-g6ctr\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 05:57:58.589705 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.589666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d" event={"ID":"1fed7b35-df4b-4ab0-8b22-c664a02521a6","Type":"ContainerDied","Data":"fa712771caad6ed252aea1d44b87efb8161c37f4a3c5e83fc04b1434790a7beb"}
Aug 05 05:57:58.589705 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.589693    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"
Aug 05 05:57:58.590202 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.589734    2581 scope.go:117] "RemoveContainer" containerID="da6001b2bb936e5fe9dc1e0de69f59c2ee8639a023a2baa49066145305172bee"
Aug 05 05:57:58.598476 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.598297    2581 scope.go:117] "RemoveContainer" containerID="823f6a737cf87949c1f212fd1ff93422ae7e02558c5466846861b5006746d0c9"
Aug 05 05:57:58.605757 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.605741    2581 scope.go:117] "RemoveContainer" containerID="da7fa2698eee44c0a12e186af09b2b2b58637ad26fc22a384eabdf2e98c43645"
Aug 05 05:57:58.612774 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.612753    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:57:58.613607 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.613593    2581 scope.go:117] "RemoveContainer" containerID="661bce8014b7364766f55744a91e69c217783aecf402e196339619c5cae82f51"
Aug 05 05:57:58.618665 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.618644    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wv78d"]
Aug 05 05:57:58.621041 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.621026    2581 scope.go:117] "RemoveContainer" containerID="ba46e147c6df9d007592925c103585f99b88ac1e805d3b7bfa2ee2d08f8c6d00"
Aug 05 05:57:58.627684 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:58.627668    2581 scope.go:117] "RemoveContainer" containerID="93fb1bdff904de7f0b655b41fd34eaab115a0e1e6c16fd984f4b52028b9d6f41"
Aug 05 05:57:59.241641 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:57:59.241607    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" path="/var/lib/kubelet/pods/1fed7b35-df4b-4ab0-8b22-c664a02521a6/volumes"
Aug 05 05:58:49.034595 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.034557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035016    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035037    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035062    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="feast-apply"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035070    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="feast-apply"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035079    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035087    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035105    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035113    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035132    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035140    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="feast-init"
Aug 05 05:58:49.035219 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035166    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="feast-init"
Aug 05 05:58:49.035597 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035234    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="online"
Aug 05 05:58:49.035597 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035245    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="ui"
Aug 05 05:58:49.035597 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035257    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="offline"
Aug 05 05:58:49.035597 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.035266    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fed7b35-df4b-4ab0-8b22-c664a02521a6" containerName="registry"
Aug 05 05:58:49.039005 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.038986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.041202 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Aug 05 05:58:49.041202 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041189    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Aug 05 05:58:49.041456 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Aug 05 05:58:49.041497 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041460    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Aug 05 05:58:49.041786 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Aug 05 05:58:49.041880 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Aug 05 05:58:49.041965 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.041897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-kv82d\""
Aug 05 05:58:49.047613 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.047587    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 05:58:49.094287 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.094409 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.094409 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.094504 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.094504 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jw9\" (UniqueName: \"kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.094504 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.094498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.195784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.195747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.195784 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.195785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.195805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:58:49.195897    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.195920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: E0805 05:58:49.196014    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls podName:71973427-dca5-4d3a-91b9-48f2e23c2dfc nodeName:}" failed. No retries permitted until 2026-08-05 05:58:49.695993156 +0000 UTC m=+1373.105652094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-q7htm" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.196033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jw9\" (UniqueName: \"kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196075 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.196065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196391 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.196183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.196524 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.196503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.198391 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.198366    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.198515 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.198490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.205773 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.205745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jw9\" (UniqueName: \"kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.700396 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.700352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.702830 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.702804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-q7htm\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:49.950695 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:49.950597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:58:50.082827 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:50.082797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 05:58:50.085766 ip-10-0-134-152 kubenswrapper[2581]: W0805 05:58:50.085738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71973427_dca5_4d3a_91b9_48f2e23c2dfc.slice/crio-0a60d35388b2995098a929933ada59a40079b341187d732bb2c18e3635722d26 WatchSource:0}: Error finding container 0a60d35388b2995098a929933ada59a40079b341187d732bb2c18e3635722d26: Status 404 returned error can't find the container with id 0a60d35388b2995098a929933ada59a40079b341187d732bb2c18e3635722d26
Aug 05 05:58:50.789814 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:50.789781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"}
Aug 05 05:58:50.790006 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:50.789824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"0a60d35388b2995098a929933ada59a40079b341187d732bb2c18e3635722d26"}
Aug 05 05:58:54.811825 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:54.811797    2581 generic.go:356] "Generic (PLEG): container finished" podID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerID="c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43" exitCode=0
Aug 05 05:58:54.812291 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:54.811844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"}
Aug 05 05:58:55.818391 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:58:55.818360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"}
Aug 05 05:59:00.838609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:00.838528    2581 generic.go:356] "Generic (PLEG): container finished" podID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerID="2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015" exitCode=0
Aug 05 05:59:00.838609 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:00.838570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"}
Aug 05 05:59:01.846169 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.846129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"}
Aug 05 05:59:01.846662 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.846190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"}
Aug 05 05:59:01.846662 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.846213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerStarted","Data":"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"}
Aug 05 05:59:01.872759 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.872689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podStartSLOduration=12.872667207 podStartE2EDuration="12.872667207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 05:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 05:59:01.871581883 +0000 UTC m=+1385.281240831" watchObservedRunningTime="2026-08-05 05:59:01.872667207 +0000 UTC m=+1385.282326159"
Aug 05 05:59:01.951131 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.951091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:01.951304 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.951153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:01.951304 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.951170    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:01.953329 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.953293    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Aug 05 05:59:01.953466 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.953341    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Aug 05 05:59:01.953466 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:01.953342    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Aug 05 05:59:04.951543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:04.951495    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Aug 05 05:59:04.951543 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:04.951517    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Aug 05 05:59:04.952113 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:04.951503    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Aug 05 05:59:07.952075 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.952041    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.952538 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.952316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.952692 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.952664    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.952822 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.952708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.952930 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.952911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.953063 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.953046    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:07.959094 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:07.959072    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:08.876300 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:08.876275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 05:59:08.880854 ip-10-0-134-152 kubenswrapper[2581]: I0805 05:59:08.880824    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 06:00:10.390709 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.390674    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 06:00:10.391253 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.390889    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" containerID="cri-o://06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b" gracePeriod=30
Aug 05 06:00:10.391253 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.390985    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" containerID="cri-o://38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149" gracePeriod=30
Aug 05 06:00:10.391253 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.390985    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline" containerID="cri-o://28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392" gracePeriod=30
Aug 05 06:00:10.494771 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.494739    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 06:00:10.495067 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.495035    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="registry" containerID="cri-o://b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae" gracePeriod=30
Aug 05 06:00:10.495224 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.495085    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui" containerID="cri-o://e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856" gracePeriod=30
Aug 05 06:00:10.495224 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.495085    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="offline" containerID="cri-o://3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9" gracePeriod=30
Aug 05 06:00:10.495350 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:10.495090    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online" containerID="cri-o://aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f" gracePeriod=30
Aug 05 06:00:11.118318 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.118285    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856" exitCode=0
Aug 05 06:00:11.118472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.118359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"}
Aug 05 06:00:11.121114 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.121093    2581 generic.go:356] "Generic (PLEG): container finished" podID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerID="38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149" exitCode=0
Aug 05 06:00:11.121114 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.121113    2581 generic.go:356] "Generic (PLEG): container finished" podID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerID="06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b" exitCode=0
Aug 05 06:00:11.121253 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.121160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"}
Aug 05 06:00:11.121253 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:11.121188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"}
Aug 05 06:00:12.127778 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:12.127743    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f" exitCode=0
Aug 05 06:00:12.128174 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:12.127814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"}
Aug 05 06:00:16.540044 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:16.539997    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Aug 05 06:00:16.540538 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:16.540249    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Aug 05 06:00:17.953212 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:17.953159    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Aug 05 06:00:18.876612 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:18.876572    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Aug 05 06:00:26.540602 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:26.540557    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Aug 05 06:00:26.540602 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:26.540593    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Aug 05 06:00:27.953627 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:27.953583    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Aug 05 06:00:28.877174 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:28.877134    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Aug 05 06:00:36.539867 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:36.539827    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Aug 05 06:00:36.540263 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:36.539983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 06:00:36.540361 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:36.540336    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Aug 05 06:00:36.540438 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:36.540427    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 06:00:37.952907 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:37.952868    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Aug 05 06:00:37.953390 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:37.953000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 06:00:38.877207 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:38.877166    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Aug 05 06:00:38.877378 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:38.877296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 06:00:41.034225 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.034200    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 06:00:41.132344 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132315    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jw9\" (UniqueName: \"kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132497 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132497 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132416    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132497 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132450    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132679 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132621    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132734 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") pod \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\" (UID: \"71973427-dca5-4d3a-91b9-48f2e23c2dfc\") "
Aug 05 06:00:41.132987 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.132939    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 06:00:41.133276 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.133246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data" (OuterVolumeSpecName: "feast-data") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:00:41.134750 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.134722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls" (OuterVolumeSpecName: "online-tls") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.134841 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.134747    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9" (OuterVolumeSpecName: "kube-api-access-88jw9") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "kube-api-access-88jw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:00:41.134841 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.134772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.134932 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.134884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "71973427-dca5-4d3a-91b9-48f2e23c2dfc" (UID: "71973427-dca5-4d3a-91b9-48f2e23c2dfc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.144194 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.144175    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 06:00:41.233921 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.233895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234060 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.233942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnb46\" (UniqueName: \"kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234060 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.233986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234060 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234036    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234060 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234229 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls\") pod \"e1d22350-080f-4b25-a7b3-2873c5a67308\" (UID: \"e1d22350-080f-4b25-a7b3-2873c5a67308\") "
Aug 05 06:00:41.234339 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234322    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234344    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71973427-dca5-4d3a-91b9-48f2e23c2dfc-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234358    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234372    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jw9\" (UniqueName: \"kubernetes.io/projected/71973427-dca5-4d3a-91b9-48f2e23c2dfc-kube-api-access-88jw9\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234385    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/71973427-dca5-4d3a-91b9-48f2e23c2dfc-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234399    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71973427-dca5-4d3a-91b9-48f2e23c2dfc-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.234710 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.234575    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data" (OuterVolumeSpecName: "feast-data") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:00:41.236332 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.236291    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.236546 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.236496    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.236663 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.236586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46" (OuterVolumeSpecName: "kube-api-access-wnb46") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "kube-api-access-wnb46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:00:41.236663 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.236612    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.236744 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.236664    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls" (OuterVolumeSpecName: "online-tls") pod "e1d22350-080f-4b25-a7b3-2873c5a67308" (UID: "e1d22350-080f-4b25-a7b3-2873c5a67308"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:00:41.242195 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.242167    2581 generic.go:356] "Generic (PLEG): container finished" podID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerID="28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392" exitCode=137
Aug 05 06:00:41.242302 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.242222    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"
Aug 05 06:00:41.242302 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.242243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"}
Aug 05 06:00:41.242302 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.242299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm" event={"ID":"71973427-dca5-4d3a-91b9-48f2e23c2dfc","Type":"ContainerDied","Data":"0a60d35388b2995098a929933ada59a40079b341187d732bb2c18e3635722d26"}
Aug 05 06:00:41.242454 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.242325    2581 scope.go:117] "RemoveContainer" containerID="38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"
Aug 05 06:00:41.245539 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245516    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9" exitCode=137
Aug 05 06:00:41.245539 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245537    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerID="b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae" exitCode=137
Aug 05 06:00:41.245701 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"}
Aug 05 06:00:41.245701 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245590    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"
Aug 05 06:00:41.245701 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"}
Aug 05 06:00:41.245861 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.245707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq" event={"ID":"e1d22350-080f-4b25-a7b3-2873c5a67308","Type":"ContainerDied","Data":"53c4a57d78699c1ffa8beb57f812919614be766d2455d395adedaeb8d63c445f"}
Aug 05 06:00:41.252986 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.252962    2581 scope.go:117] "RemoveContainer" containerID="28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"
Aug 05 06:00:41.260668 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.260653    2581 scope.go:117] "RemoveContainer" containerID="06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"
Aug 05 06:00:41.267871 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.267850    2581 scope.go:117] "RemoveContainer" containerID="2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"
Aug 05 06:00:41.270059 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.270038    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 06:00:41.273336 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.273319    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-q7htm"]
Aug 05 06:00:41.275825 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.275809    2581 scope.go:117] "RemoveContainer" containerID="c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"
Aug 05 06:00:41.282480 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.282464    2581 scope.go:117] "RemoveContainer" containerID="38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"
Aug 05 06:00:41.282776 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.282750    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149\": container with ID starting with 38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149 not found: ID does not exist" containerID="38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"
Aug 05 06:00:41.282885 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.282777    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149"} err="failed to get container status \"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149\": rpc error: code = NotFound desc = could not find container \"38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149\": container with ID starting with 38ee2d2105594f5c6cc5395a21eb720b6f8abcb7004b8128ff77cfd0bd40a149 not found: ID does not exist"
Aug 05 06:00:41.282885 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.282798    2581 scope.go:117] "RemoveContainer" containerID="28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"
Aug 05 06:00:41.283163 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.283135    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392\": container with ID starting with 28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392 not found: ID does not exist" containerID="28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"
Aug 05 06:00:41.283249 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283172    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392"} err="failed to get container status \"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392\": rpc error: code = NotFound desc = could not find container \"28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392\": container with ID starting with 28be3dbe2aeb294c2d221aa65acf1c9a94d81de009082da6f204dde304bb2392 not found: ID does not exist"
Aug 05 06:00:41.283249 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283195    2581 scope.go:117] "RemoveContainer" containerID="06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"
Aug 05 06:00:41.283532 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.283496    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b\": container with ID starting with 06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b not found: ID does not exist" containerID="06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"
Aug 05 06:00:41.283613 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283539    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b"} err="failed to get container status \"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b\": rpc error: code = NotFound desc = could not find container \"06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b\": container with ID starting with 06110f92d4ef491c0682c334bb694b2dce4b20dfd5249d2e35db7db71de41f7b not found: ID does not exist"
Aug 05 06:00:41.283613 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283560    2581 scope.go:117] "RemoveContainer" containerID="2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"
Aug 05 06:00:41.283863 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.283843    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015\": container with ID starting with 2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015 not found: ID does not exist" containerID="2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"
Aug 05 06:00:41.283924 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283868    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015"} err="failed to get container status \"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015\": rpc error: code = NotFound desc = could not find container \"2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015\": container with ID starting with 2d8c74beb8f8b9e103611e5b7731f53dc08ec4930eed246c642f337509c3a015 not found: ID does not exist"
Aug 05 06:00:41.283924 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.283882    2581 scope.go:117] "RemoveContainer" containerID="c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"
Aug 05 06:00:41.284148 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.284130    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43\": container with ID starting with c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43 not found: ID does not exist" containerID="c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"
Aug 05 06:00:41.284210 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.284153    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43"} err="failed to get container status \"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43\": rpc error: code = NotFound desc = could not find container \"c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43\": container with ID starting with c331a397e14e3447942ed7803a72153d21f95d439496f30d37f3c4eb77122e43 not found: ID does not exist"
Aug 05 06:00:41.284210 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.284166    2581 scope.go:117] "RemoveContainer" containerID="e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"
Aug 05 06:00:41.285210 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.285194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 06:00:41.288802 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.288783    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rjhtq"]
Aug 05 06:00:41.291523 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.291508    2581 scope.go:117] "RemoveContainer" containerID="3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"
Aug 05 06:00:41.298483 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.298468    2581 scope.go:117] "RemoveContainer" containerID="aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"
Aug 05 06:00:41.305298 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.305282    2581 scope.go:117] "RemoveContainer" containerID="b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"
Aug 05 06:00:41.312083 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.312066    2581 scope.go:117] "RemoveContainer" containerID="da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"
Aug 05 06:00:41.318618 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.318603    2581 scope.go:117] "RemoveContainer" containerID="296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"
Aug 05 06:00:41.325379 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.325364    2581 scope.go:117] "RemoveContainer" containerID="e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"
Aug 05 06:00:41.325647 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.325632    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856\": container with ID starting with e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856 not found: ID does not exist" containerID="e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"
Aug 05 06:00:41.325694 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.325657    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"} err="failed to get container status \"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856\": rpc error: code = NotFound desc = could not find container \"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856\": container with ID starting with e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856 not found: ID does not exist"
Aug 05 06:00:41.325694 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.325673    2581 scope.go:117] "RemoveContainer" containerID="3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"
Aug 05 06:00:41.325895 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.325878    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9\": container with ID starting with 3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9 not found: ID does not exist" containerID="3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"
Aug 05 06:00:41.325976 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.325909    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"} err="failed to get container status \"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9\": rpc error: code = NotFound desc = could not find container \"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9\": container with ID starting with 3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9 not found: ID does not exist"
Aug 05 06:00:41.325976 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.325926    2581 scope.go:117] "RemoveContainer" containerID="aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"
Aug 05 06:00:41.326215 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.326185    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f\": container with ID starting with aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f not found: ID does not exist" containerID="aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"
Aug 05 06:00:41.326267 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326221    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"} err="failed to get container status \"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f\": rpc error: code = NotFound desc = could not find container \"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f\": container with ID starting with aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f not found: ID does not exist"
Aug 05 06:00:41.326267 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326238    2581 scope.go:117] "RemoveContainer" containerID="b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"
Aug 05 06:00:41.326460 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.326444    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae\": container with ID starting with b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae not found: ID does not exist" containerID="b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"
Aug 05 06:00:41.326508 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326463    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"} err="failed to get container status \"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae\": rpc error: code = NotFound desc = could not find container \"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae\": container with ID starting with b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae not found: ID does not exist"
Aug 05 06:00:41.326508 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326477    2581 scope.go:117] "RemoveContainer" containerID="da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"
Aug 05 06:00:41.326675 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.326661    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a\": container with ID starting with da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a not found: ID does not exist" containerID="da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"
Aug 05 06:00:41.326714 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"} err="failed to get container status \"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a\": rpc error: code = NotFound desc = could not find container \"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a\": container with ID starting with da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a not found: ID does not exist"
Aug 05 06:00:41.326714 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326689    2581 scope.go:117] "RemoveContainer" containerID="296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"
Aug 05 06:00:41.326884 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:00:41.326870    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780\": container with ID starting with 296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780 not found: ID does not exist" containerID="296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"
Aug 05 06:00:41.326924 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326887    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"} err="failed to get container status \"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780\": rpc error: code = NotFound desc = could not find container \"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780\": container with ID starting with 296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780 not found: ID does not exist"
Aug 05 06:00:41.326924 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.326903    2581 scope.go:117] "RemoveContainer" containerID="e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"
Aug 05 06:00:41.327136 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327120    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856"} err="failed to get container status \"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856\": rpc error: code = NotFound desc = could not find container \"e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856\": container with ID starting with e56be3adb875620e6265590322d0291b79dd5d8e7cced20e6bc2ac600910d856 not found: ID does not exist"
Aug 05 06:00:41.327184 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327135    2581 scope.go:117] "RemoveContainer" containerID="3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"
Aug 05 06:00:41.327323 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327306    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9"} err="failed to get container status \"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9\": rpc error: code = NotFound desc = could not find container \"3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9\": container with ID starting with 3c3756d276a78994d82509830a309dc90eec0170c729866187f246042df065f9 not found: ID does not exist"
Aug 05 06:00:41.327323 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327322    2581 scope.go:117] "RemoveContainer" containerID="aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"
Aug 05 06:00:41.327553 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327534    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f"} err="failed to get container status \"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f\": rpc error: code = NotFound desc = could not find container \"aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f\": container with ID starting with aea7d1a91b1693637a6d97d13d0bbf41e10a395d3a6ad9bd0cb45bd47bcea44f not found: ID does not exist"
Aug 05 06:00:41.327553 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327553    2581 scope.go:117] "RemoveContainer" containerID="b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"
Aug 05 06:00:41.327796 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327781    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae"} err="failed to get container status \"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae\": rpc error: code = NotFound desc = could not find container \"b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae\": container with ID starting with b96306c36330b7c43b29ab0551e69ec99e4da43efbe7da0cbb990cb15b26b4ae not found: ID does not exist"
Aug 05 06:00:41.327845 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327797    2581 scope.go:117] "RemoveContainer" containerID="da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"
Aug 05 06:00:41.328010 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.327994    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a"} err="failed to get container status \"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a\": rpc error: code = NotFound desc = could not find container \"da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a\": container with ID starting with da5bd616d1ebef0c16d8be4a9dc6852d28d5c1c6a22fa378e745c0194d8fd70a not found: ID does not exist"
Aug 05 06:00:41.328052 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.328011    2581 scope.go:117] "RemoveContainer" containerID="296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"
Aug 05 06:00:41.328180 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.328156    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780"} err="failed to get container status \"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780\": rpc error: code = NotFound desc = could not find container \"296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780\": container with ID starting with 296fee0cd0fdb8cc0be48718535a966dab4fbadb4e0ee773b3c6346d49cc6780 not found: ID does not exist"
Aug 05 06:00:41.335692 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335674    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.335774 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335696    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.335774 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335709    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnb46\" (UniqueName: \"kubernetes.io/projected/e1d22350-080f-4b25-a7b3-2873c5a67308-kube-api-access-wnb46\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.335774 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335723    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1d22350-080f-4b25-a7b3-2873c5a67308-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.335774 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335738    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:41.335774 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:41.335750    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1d22350-080f-4b25-a7b3-2873c5a67308-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:00:43.240910 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:43.240876    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" path="/var/lib/kubelet/pods/71973427-dca5-4d3a-91b9-48f2e23c2dfc/volumes"
Aug 05 06:00:43.241431 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:00:43.241417    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" path="/var/lib/kubelet/pods/e1d22350-080f-4b25-a7b3-2873c5a67308/volumes"
Aug 05 06:01:21.025968 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.025862    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026371    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="feast-apply"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="feast-apply"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026402    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026411    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026423    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="feast-init"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026433    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="feast-init"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026443    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="feast-apply"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026452    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="feast-apply"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026465    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="registry"
Aug 05 06:01:21.026472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026473    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="registry"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026484    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026492    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026504    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026514    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026523    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="feast-init"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026532    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="feast-init"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026543    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026550    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026559    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026568    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026586    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026682    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026697    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026706    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="online"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026715    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="offline"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026725    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="registry"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026733    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71973427-dca5-4d3a-91b9-48f2e23c2dfc" containerName="ui"
Aug 05 06:01:21.027011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.026743    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d22350-080f-4b25-a7b3-2873c5a67308" containerName="online"
Aug 05 06:01:21.030374 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.030350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.032684 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.032657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Aug 05 06:01:21.032826 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.032785    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Aug 05 06:01:21.032919 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.032899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Aug 05 06:01:21.033154 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.033135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-656ts\""
Aug 05 06:01:21.033271 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.033208    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Aug 05 06:01:21.033271 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.033140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Aug 05 06:01:21.033485 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.033412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Aug 05 06:01:21.042470 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.042449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:01:21.141209 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.141376 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.141376 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.141376 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vznr4\" (UniqueName: \"kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.141376 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.141541 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.141415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.241919 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.241886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242073 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.241926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242073 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242041    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 06:01:21.242159 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242099    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls podName:71c45fdb-523e-45a6-97e5-8d856f503de9 nodeName:}" failed. No retries permitted until 2026-08-05 06:01:21.742078645 +0000 UTC m=+1525.151737577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls") pod "feast-simple-feast-setup-777d6cc998-j5ql9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9") : secret "feast-simple-feast-setup-registry-tls" not found
Aug 05 06:01:21.242159 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.242115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242159 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.242140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vznr4\" (UniqueName: \"kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242329 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.242169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242329 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242277    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 06:01:21.242329 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.242320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.242503 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242342    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls podName:71c45fdb-523e-45a6-97e5-8d856f503de9 nodeName:}" failed. No retries permitted until 2026-08-05 06:01:21.742323787 +0000 UTC m=+1525.151982715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls") pod "feast-simple-feast-setup-777d6cc998-j5ql9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9") : secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 06:01:21.242503 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242382    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 06:01:21.242503 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:01:21.242428    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls podName:71c45fdb-523e-45a6-97e5-8d856f503de9 nodeName:}" failed. No retries permitted until 2026-08-05 06:01:21.742417284 +0000 UTC m=+1525.152076215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls") pod "feast-simple-feast-setup-777d6cc998-j5ql9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9") : secret "feast-simple-feast-setup-offline-tls" not found
Aug 05 06:01:21.242762 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.242741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.244463 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.244444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.251190 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.251170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vznr4\" (UniqueName: \"kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.747869 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.747832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.748079 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.747877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.748079 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.747912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.750282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.750259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.750282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.750271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.750435 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.750383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-j5ql9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:21.947689 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:21.947648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:22.079164 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:22.079133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:01:22.082160 ip-10-0-134-152 kubenswrapper[2581]: W0805 06:01:22.082133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71c45fdb_523e_45a6_97e5_8d856f503de9.slice/crio-6a158b411ecb571a47e7de09e1db8ee9ff979451b1bae11ebb81c9d529893f31 WatchSource:0}: Error finding container 6a158b411ecb571a47e7de09e1db8ee9ff979451b1bae11ebb81c9d529893f31: Status 404 returned error can't find the container with id 6a158b411ecb571a47e7de09e1db8ee9ff979451b1bae11ebb81c9d529893f31
Aug 05 06:01:22.408610 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:22.407808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"9eb53e44d2ef0d5cf97c0462782858c9afb14a20813e56ca3a8696004083700d"}
Aug 05 06:01:22.408610 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:22.407861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"6a158b411ecb571a47e7de09e1db8ee9ff979451b1bae11ebb81c9d529893f31"}
Aug 05 06:01:27.430898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:27.430863    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="9eb53e44d2ef0d5cf97c0462782858c9afb14a20813e56ca3a8696004083700d" exitCode=0
Aug 05 06:01:27.431311 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:27.430926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"9eb53e44d2ef0d5cf97c0462782858c9afb14a20813e56ca3a8696004083700d"}
Aug 05 06:01:28.437469 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:28.437434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"d478cd66bc17dd399eb2ad720bb10e4b6d7544da62ed9072755381d0d216bec2"}
Aug 05 06:01:33.458472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:33.458385    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="d478cd66bc17dd399eb2ad720bb10e4b6d7544da62ed9072755381d0d216bec2" exitCode=0
Aug 05 06:01:33.458472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:33.458456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"d478cd66bc17dd399eb2ad720bb10e4b6d7544da62ed9072755381d0d216bec2"}
Aug 05 06:01:34.468472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:34.468433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"aa7f3cdcdce685e18bc52268868fcbc7733622e679358ea1c329a0ccbdfec062"}
Aug 05 06:01:34.468967 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:34.468492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"bb7639c134d2c022a6d69fc260324e6afc4c3564d7f4ae27270ead0d434a4f66"}
Aug 05 06:01:34.468967 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:34.468511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"99b688d9daeb4221d35259033c192238754b47c0c86700280bfa7b93ac463937"}
Aug 05 06:01:34.468967 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:34.468529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerStarted","Data":"443282e34ee56b2751384a020c2c3511beef7c9c9c46fa16802ae2cdada2104e"}
Aug 05 06:01:34.491556 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:34.491495    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podStartSLOduration=13.491473073 podStartE2EDuration="13.491473073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 06:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 06:01:34.489870694 +0000 UTC m=+1537.899529642" watchObservedRunningTime="2026-08-05 06:01:34.491473073 +0000 UTC m=+1537.901132023"
Aug 05 06:01:36.948160 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.948123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:36.948926 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.948191    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:36.948926 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.948213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:36.948926 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.948230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:36.950291 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.950260    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Aug 05 06:01:36.950516 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.950265    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Aug 05 06:01:36.950704 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.950311    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.37:6571: connect: connection refused"
Aug 05 06:01:36.950782 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:36.950326    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused"
Aug 05 06:01:39.949224 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.949599 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.949599 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.949980 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.949980 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.950139 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.949987    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.950190 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.950161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.950225 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.950210    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.950403 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.950390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:39.954309 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:39.954287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:40.500335 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:40.500302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:01:40.503522 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:01:40.503503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:02:41.604680 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.604643    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:02:41.605650 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.605590    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="registry" containerID="cri-o://443282e34ee56b2751384a020c2c3511beef7c9c9c46fa16802ae2cdada2104e" gracePeriod=30
Aug 05 06:02:41.606851 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.606288    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui" containerID="cri-o://aa7f3cdcdce685e18bc52268868fcbc7733622e679358ea1c329a0ccbdfec062" gracePeriod=30
Aug 05 06:02:41.606851 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.606424    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="offline" containerID="cri-o://bb7639c134d2c022a6d69fc260324e6afc4c3564d7f4ae27270ead0d434a4f66" gracePeriod=30
Aug 05 06:02:41.606851 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.606520    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online" containerID="cri-o://99b688d9daeb4221d35259033c192238754b47c0c86700280bfa7b93ac463937" gracePeriod=30
Aug 05 06:02:41.889750 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.889654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:02:41.893735 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.893713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:41.896923 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.896895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jhxzs\""
Aug 05 06:02:41.905650 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:41.905622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:02:42.007020 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.006974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.007282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.007046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.007282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.007080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.007282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.007132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.007282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.007155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tll8r\" (UniqueName: \"kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.007282 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.007192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108505 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108727 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108727 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108727 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tll8r\" (UniqueName: \"kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108895 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.108895 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.108822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.109587 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.109204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.109587 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:02:42.109307    2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 06:02:42.109587 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:02:42.109380    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls podName:031ceb11-1cec-465d-99f3-40c81f90b950 nodeName:}" failed. No retries permitted until 2026-08-05 06:02:42.609359478 +0000 UTC m=+1606.019018408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls") pod "feast-simple-feast-setup-777d6cc998-rz7d4" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950") : secret "feast-simple-feast-setup-ui-tls" not found
Aug 05 06:02:42.111786 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.111761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.111923 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.111764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.112279 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.112250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.120704 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.120667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tll8r\" (UniqueName: \"kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.613926 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.613882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.616280 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.616257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rz7d4\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.730092 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.730057    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="aa7f3cdcdce685e18bc52268868fcbc7733622e679358ea1c329a0ccbdfec062" exitCode=0
Aug 05 06:02:42.730092 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.730085    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="99b688d9daeb4221d35259033c192238754b47c0c86700280bfa7b93ac463937" exitCode=0
Aug 05 06:02:42.730303 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.730117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"aa7f3cdcdce685e18bc52268868fcbc7733622e679358ea1c329a0ccbdfec062"}
Aug 05 06:02:42.730303 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.730155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"99b688d9daeb4221d35259033c192238754b47c0c86700280bfa7b93ac463937"}
Aug 05 06:02:42.805672 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.805638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:42.944531 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:42.944405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:02:42.946598 ip-10-0-134-152 kubenswrapper[2581]: W0805 06:02:42.946572    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod031ceb11_1cec_465d_99f3_40c81f90b950.slice/crio-ad5944f437f8f58f07962e8f469d09b9e2de2294c78d26398d3ef3a5ce93517f WatchSource:0}: Error finding container ad5944f437f8f58f07962e8f469d09b9e2de2294c78d26398d3ef3a5ce93517f: Status 404 returned error can't find the container with id ad5944f437f8f58f07962e8f469d09b9e2de2294c78d26398d3ef3a5ce93517f
Aug 05 06:02:43.735593 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:43.735557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"5671baecf2e732761ae2f11c5953ab148e636168e3886f432fd29fe3aee51083"}
Aug 05 06:02:43.735993 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:43.735603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"ad5944f437f8f58f07962e8f469d09b9e2de2294c78d26398d3ef3a5ce93517f"}
Aug 05 06:02:48.758252 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:48.758216    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="5671baecf2e732761ae2f11c5953ab148e636168e3886f432fd29fe3aee51083" exitCode=0
Aug 05 06:02:48.758661 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:48.758259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"5671baecf2e732761ae2f11c5953ab148e636168e3886f432fd29fe3aee51083"}
Aug 05 06:02:49.763391 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:49.763316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"b97b09546e1b5d0ba90b30d42a39d9cd6a115e986dd329ced1c4880ecf159ba4"}
Aug 05 06:02:49.950911 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:49.950861    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Aug 05 06:02:50.501200 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:50.501150    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Aug 05 06:02:54.793230 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:54.793189    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="b97b09546e1b5d0ba90b30d42a39d9cd6a115e986dd329ced1c4880ecf159ba4" exitCode=0
Aug 05 06:02:54.793760 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:54.793355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"b97b09546e1b5d0ba90b30d42a39d9cd6a115e986dd329ced1c4880ecf159ba4"}
Aug 05 06:02:55.803929 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:55.803885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"a80da04bef559a4db8e2ac83f8441e166a0c0c1916019a4c1fe2c709c7519a35"}
Aug 05 06:02:55.804442 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:55.803981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"b85db593d9770c03a71141627a0b85269eba3add6ffb94bcec6829e607419bd9"}
Aug 05 06:02:55.804442 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:55.804009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"6d287b0d851d5883734872cbf93adbad7dea3164c98ca41e9c3902b24a7492d2"}
Aug 05 06:02:55.804442 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:55.804027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerStarted","Data":"4c34a63893c6a99b8b67f1f71f74d9bab86d2047a7c44a0dd72722be6275dc62"}
Aug 05 06:02:55.829780 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:55.829695    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podStartSLOduration=14.829673517 podStartE2EDuration="14.829673517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 06:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 06:02:55.828031055 +0000 UTC m=+1619.237690003" watchObservedRunningTime="2026-08-05 06:02:55.829673517 +0000 UTC m=+1619.239332666"
Aug 05 06:02:57.806190 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.806108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:57.806190 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.806183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:57.806743 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.806205    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:57.806743 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.806223    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:02:57.808226 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.808194    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.38:8816: connect: connection refused"
Aug 05 06:02:57.808466 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.808212    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.38:6571: connect: connection refused"
Aug 05 06:02:57.808559 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.808224    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Aug 05 06:02:57.808559 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:57.808281    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Aug 05 06:02:59.950078 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:02:59.950030    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Aug 05 06:03:00.501582 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.501532    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Aug 05 06:03:00.807324 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.807234    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Aug 05 06:03:00.807779 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.807752    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.808297 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.808274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.808387 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.808328    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.808643 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.808626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.812753 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.812731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.833507 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.833480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.833627 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.833518    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.834026 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.834005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:00.836455 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:00.836434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:02.806106 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:02.806066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:03.807140 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:03.807102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:03.846342 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:03.846314    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:03:09.950059 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:09.950009    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused"
Aug 05 06:03:09.950503 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:09.950174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:03:10.501149 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:10.501103    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused"
Aug 05 06:03:10.501340 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:10.501216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:03:11.880053 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:11.879961    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="bb7639c134d2c022a6d69fc260324e6afc4c3564d7f4ae27270ead0d434a4f66" exitCode=137
Aug 05 06:03:11.880053 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:11.879976    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"bb7639c134d2c022a6d69fc260324e6afc4c3564d7f4ae27270ead0d434a4f66"}
Aug 05 06:03:11.880053 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:11.880025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"443282e34ee56b2751384a020c2c3511beef7c9c9c46fa16802ae2cdada2104e"}
Aug 05 06:03:11.880053 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:11.879986    2581 generic.go:356] "Generic (PLEG): container finished" podID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerID="443282e34ee56b2751384a020c2c3511beef7c9c9c46fa16802ae2cdada2104e" exitCode=137
Aug 05 06:03:12.265149 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.265123    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:03:12.369724 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369674    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.369914 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.369914 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369793    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vznr4\" (UniqueName: \"kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.369914 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369838    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.369914 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.370226 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.369914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") pod \"71c45fdb-523e-45a6-97e5-8d856f503de9\" (UID: \"71c45fdb-523e-45a6-97e5-8d856f503de9\") "
Aug 05 06:03:12.370485 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.370446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data" (OuterVolumeSpecName: "feast-data") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:03:12.372260 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.372229    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls" (OuterVolumeSpecName: "online-tls") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:03:12.372260 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.372252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:03:12.372413 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.372397    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4" (OuterVolumeSpecName: "kube-api-access-vznr4") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "kube-api-access-vznr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:03:12.372454 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.372399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:03:12.372454 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.372414    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "71c45fdb-523e-45a6-97e5-8d856f503de9" (UID: "71c45fdb-523e-45a6-97e5-8d856f503de9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470857    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470912    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470923    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vznr4\" (UniqueName: \"kubernetes.io/projected/71c45fdb-523e-45a6-97e5-8d856f503de9-kube-api-access-vznr4\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470932    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470941    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/71c45fdb-523e-45a6-97e5-8d856f503de9-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.470979 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.470973    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/71c45fdb-523e-45a6-97e5-8d856f503de9-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:03:12.886613 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.886586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"
Aug 05 06:03:12.887146 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.886587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9" event={"ID":"71c45fdb-523e-45a6-97e5-8d856f503de9","Type":"ContainerDied","Data":"6a158b411ecb571a47e7de09e1db8ee9ff979451b1bae11ebb81c9d529893f31"}
Aug 05 06:03:12.887146 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.886716    2581 scope.go:117] "RemoveContainer" containerID="aa7f3cdcdce685e18bc52268868fcbc7733622e679358ea1c329a0ccbdfec062"
Aug 05 06:03:12.895919 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.895896    2581 scope.go:117] "RemoveContainer" containerID="bb7639c134d2c022a6d69fc260324e6afc4c3564d7f4ae27270ead0d434a4f66"
Aug 05 06:03:12.903882 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.903855    2581 scope.go:117] "RemoveContainer" containerID="99b688d9daeb4221d35259033c192238754b47c0c86700280bfa7b93ac463937"
Aug 05 06:03:12.909357 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.909331    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:03:12.912353 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.912329    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-j5ql9"]
Aug 05 06:03:12.912714 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.912699    2581 scope.go:117] "RemoveContainer" containerID="443282e34ee56b2751384a020c2c3511beef7c9c9c46fa16802ae2cdada2104e"
Aug 05 06:03:12.920103 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.920087    2581 scope.go:117] "RemoveContainer" containerID="d478cd66bc17dd399eb2ad720bb10e4b6d7544da62ed9072755381d0d216bec2"
Aug 05 06:03:12.928393 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:12.928368    2581 scope.go:117] "RemoveContainer" containerID="9eb53e44d2ef0d5cf97c0462782858c9afb14a20813e56ca3a8696004083700d"
Aug 05 06:03:13.241730 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:03:13.241689    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" path="/var/lib/kubelet/pods/71c45fdb-523e-45a6-97e5-8d856f503de9/volumes"
Aug 05 06:04:05.191167 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191128    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="feast-init"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191558    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="feast-init"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191583    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191591    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191601    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191610    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191624    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="offline"
Aug 05 06:04:05.191639 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191632    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="offline"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191645    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="feast-apply"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191653    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="feast-apply"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191675    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="registry"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191684    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="registry"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191769    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="ui"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191780    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="online"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191791    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="registry"
Aug 05 06:04:05.191889 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.191799    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c45fdb-523e-45a6-97e5-8d856f503de9" containerName="offline"
Aug 05 06:04:05.195489 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.195471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.197735 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.197711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Aug 05 06:04:05.198011 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.197987    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Aug 05 06:04:05.198117 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.198090    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Aug 05 06:04:05.198221 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.198195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Aug 05 06:04:05.198221 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.198203    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Aug 05 06:04:05.198356 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.198344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mpwzs\""
Aug 05 06:04:05.198429 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.198403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Aug 05 06:04:05.206528 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.206503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:04:05.304714 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.304872 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.304872 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.304872 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.305093 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.305093 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.304930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgwq\" (UniqueName: \"kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.405961 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.405921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.405982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgwq\" (UniqueName: \"kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406396 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:04:05.406179    2581 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Aug 05 06:04:05.406396 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:04:05.406245    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls podName:a3569472-2f42-4f06-b6be-1afea1de11f9 nodeName:}" failed. No retries permitted until 2026-08-05 06:04:05.906224522 +0000 UTC m=+1689.315883464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls") pod "feast-simple-feast-remote-setup-db6955c6c-kc7hd" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9") : secret "feast-simple-feast-remote-setup-online-tls" not found
Aug 05 06:04:05.406506 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.406895 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.406872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.408472 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.408453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.408545 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.408496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.414361 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.414337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgwq\" (UniqueName: \"kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.910851 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.910813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:05.913153 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:05.913123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-kc7hd\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:06.105900 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:06.105868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:06.236454 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:06.236431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:04:06.237996 ip-10-0-134-152 kubenswrapper[2581]: W0805 06:04:06.237971    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3569472_2f42_4f06_b6be_1afea1de11f9.slice/crio-101240733b3212565431cc62e9600670e95dee0b04fa9b7714a426dc6915a91c WatchSource:0}: Error finding container 101240733b3212565431cc62e9600670e95dee0b04fa9b7714a426dc6915a91c: Status 404 returned error can't find the container with id 101240733b3212565431cc62e9600670e95dee0b04fa9b7714a426dc6915a91c
Aug 05 06:04:07.098864 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:07.098818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"}
Aug 05 06:04:07.099068 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:07.098879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"101240733b3212565431cc62e9600670e95dee0b04fa9b7714a426dc6915a91c"}
Aug 05 06:04:12.121485 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:12.121449    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerID="0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47" exitCode=0
Aug 05 06:04:12.121892 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:12.121525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"}
Aug 05 06:04:13.127926 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:13.127889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"}
Aug 05 06:04:18.150284 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:18.150254    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerID="37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d" exitCode=0
Aug 05 06:04:18.150648 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:18.150326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"}
Aug 05 06:04:19.159057 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:19.159015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"}
Aug 05 06:04:19.159528 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:19.159069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"}
Aug 05 06:04:19.159528 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:19.159084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerStarted","Data":"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"}
Aug 05 06:04:19.183218 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:19.183174    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podStartSLOduration=14.18315618 podStartE2EDuration="14.18315618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 06:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 06:04:19.181709818 +0000 UTC m=+1702.591368767" watchObservedRunningTime="2026-08-05 06:04:19.18315618 +0000 UTC m=+1702.592815128"
Aug 05 06:04:21.106965 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.106911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:21.107437 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.106998    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:21.107437 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.107019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:21.108749 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.108708    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Aug 05 06:04:21.108749 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.108725    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Aug 05 06:04:21.108904 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:21.108786    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.39:8816: connect: connection refused"
Aug 05 06:04:24.106364 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.106311    2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Aug 05 06:04:24.107216 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.107194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:24.107664 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.107641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:24.108122 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.108104    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:24.114511 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.114490    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:24.183600 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.183571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:24.187759 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:24.187731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:26.106372 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:26.106333    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:27.107209 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:27.107179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:04:27.196891 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:04:27.196859    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:05:28.220083 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.220047    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:05:28.220828 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.220340    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online" containerID="cri-o://68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89" gracePeriod=30
Aug 05 06:05:28.220828 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.220420    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" containerID="cri-o://f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65" gracePeriod=30
Aug 05 06:05:28.220828 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.220430    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="offline" containerID="cri-o://b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d" gracePeriod=30
Aug 05 06:05:28.370675 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.370641    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:05:28.371008 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.370910    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="registry" containerID="cri-o://4c34a63893c6a99b8b67f1f71f74d9bab86d2047a7c44a0dd72722be6275dc62" gracePeriod=30
Aug 05 06:05:28.371008 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.370979    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" containerID="cri-o://a80da04bef559a4db8e2ac83f8441e166a0c0c1916019a4c1fe2c709c7519a35" gracePeriod=30
Aug 05 06:05:28.371210 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.370979    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online" containerID="cri-o://6d287b0d851d5883734872cbf93adbad7dea3164c98ca41e9c3902b24a7492d2" gracePeriod=30
Aug 05 06:05:28.371210 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:28.370972    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="offline" containerID="cri-o://b85db593d9770c03a71141627a0b85269eba3add6ffb94bcec6829e607419bd9" gracePeriod=30
Aug 05 06:05:29.438736 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.438654    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="a80da04bef559a4db8e2ac83f8441e166a0c0c1916019a4c1fe2c709c7519a35" exitCode=0
Aug 05 06:05:29.438736 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.438681    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="6d287b0d851d5883734872cbf93adbad7dea3164c98ca41e9c3902b24a7492d2" exitCode=0
Aug 05 06:05:29.438736 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.438720    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"a80da04bef559a4db8e2ac83f8441e166a0c0c1916019a4c1fe2c709c7519a35"}
Aug 05 06:05:29.439327 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.438759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"6d287b0d851d5883734872cbf93adbad7dea3164c98ca41e9c3902b24a7492d2"}
Aug 05 06:05:29.441206 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.441187    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerID="f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65" exitCode=0
Aug 05 06:05:29.441206 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.441203    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerID="68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89" exitCode=0
Aug 05 06:05:29.441347 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.441219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"}
Aug 05 06:05:29.441347 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:29.441243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"}
Aug 05 06:05:30.834227 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:30.834188    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Aug 05 06:05:33.845917 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:33.845872    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Aug 05 06:05:34.184066 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:34.183971    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Aug 05 06:05:37.197099 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:37.197056    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Aug 05 06:05:40.833602 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:40.833557    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Aug 05 06:05:43.846693 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:43.846650    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Aug 05 06:05:44.184221 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:44.184128    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Aug 05 06:05:47.197314 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:47.197268    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Aug 05 06:05:50.833760 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:50.833703    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online" probeResult="failure" output="Get \"https://10.132.0.38:6567/health\": dial tcp 10.132.0.38:6567: connect: connection refused"
Aug 05 06:05:50.834222 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:50.833864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:05:53.846594 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:53.846544    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.38:8443: connect: connection refused"
Aug 05 06:05:53.847089 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:53.846682    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:05:54.184798 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:54.184704    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.39:6567/health\": dial tcp 10.132.0.39:6567: connect: connection refused"
Aug 05 06:05:54.185029 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:54.184847    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:05:57.197301 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:57.197249    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.39:8443: connect: connection refused"
Aug 05 06:05:57.197699 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:57.197398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:05:58.500438 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.500375    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:05:58.538710 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.538898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.538898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538752    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.538898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.538898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538841    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.538898 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.538885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pgwq\" (UniqueName: \"kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq\") pod \"a3569472-2f42-4f06-b6be-1afea1de11f9\" (UID: \"a3569472-2f42-4f06-b6be-1afea1de11f9\") "
Aug 05 06:05:58.539213 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.539134    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 06:05:58.539514 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.539477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data" (OuterVolumeSpecName: "feast-data") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:05:58.541167 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.541133    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:58.541167 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.541149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:58.541332 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.541210    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq" (OuterVolumeSpecName: "kube-api-access-7pgwq") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "kube-api-access-7pgwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:05:58.541381 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.541332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls" (OuterVolumeSpecName: "online-tls") pod "a3569472-2f42-4f06-b6be-1afea1de11f9" (UID: "a3569472-2f42-4f06-b6be-1afea1de11f9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:58.564837 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.564808    2581 generic.go:356] "Generic (PLEG): container finished" podID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerID="b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d" exitCode=137
Aug 05 06:05:58.564999 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.564871    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"
Aug 05 06:05:58.564999 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.564899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"}
Aug 05 06:05:58.564999 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.564934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd" event={"ID":"a3569472-2f42-4f06-b6be-1afea1de11f9","Type":"ContainerDied","Data":"101240733b3212565431cc62e9600670e95dee0b04fa9b7714a426dc6915a91c"}
Aug 05 06:05:58.564999 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.564971    2581 scope.go:117] "RemoveContainer" containerID="f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"
Aug 05 06:05:58.568328 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.568302    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="b85db593d9770c03a71141627a0b85269eba3add6ffb94bcec6829e607419bd9" exitCode=137
Aug 05 06:05:58.568328 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.568326    2581 generic.go:356] "Generic (PLEG): container finished" podID="031ceb11-1cec-465d-99f3-40c81f90b950" containerID="4c34a63893c6a99b8b67f1f71f74d9bab86d2047a7c44a0dd72722be6275dc62" exitCode=137
Aug 05 06:05:58.568520 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.568355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"b85db593d9770c03a71141627a0b85269eba3add6ffb94bcec6829e607419bd9"}
Aug 05 06:05:58.568520 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.568392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"4c34a63893c6a99b8b67f1f71f74d9bab86d2047a7c44a0dd72722be6275dc62"}
Aug 05 06:05:58.573830 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.573813    2581 scope.go:117] "RemoveContainer" containerID="b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"
Aug 05 06:05:58.583050 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.581805    2581 scope.go:117] "RemoveContainer" containerID="68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"
Aug 05 06:05:58.586994 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.586972    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:05:58.591366 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.591347    2581 scope.go:117] "RemoveContainer" containerID="37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"
Aug 05 06:05:58.591440 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.591422    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-kc7hd"]
Aug 05 06:05:58.598775 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.598760    2581 scope.go:117] "RemoveContainer" containerID="0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"
Aug 05 06:05:58.605627 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.605598    2581 scope.go:117] "RemoveContainer" containerID="f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"
Aug 05 06:05:58.605876 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:05:58.605857    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65\": container with ID starting with f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65 not found: ID does not exist" containerID="f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"
Aug 05 06:05:58.605958 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.605883    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65"} err="failed to get container status \"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65\": rpc error: code = NotFound desc = could not find container \"f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65\": container with ID starting with f31531b1aa2e588b11aebe017e84c426f479fa63b789f6d2396abf12a9f20d65 not found: ID does not exist"
Aug 05 06:05:58.605958 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.605900    2581 scope.go:117] "RemoveContainer" containerID="b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"
Aug 05 06:05:58.606154 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:05:58.606139    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d\": container with ID starting with b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d not found: ID does not exist" containerID="b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"
Aug 05 06:05:58.606200 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606158    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d"} err="failed to get container status \"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d\": rpc error: code = NotFound desc = could not find container \"b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d\": container with ID starting with b9b20c698d0117951d56dd1164d3f1b1d14ec75c4e573aaa4cf69f6a040fbc2d not found: ID does not exist"
Aug 05 06:05:58.606200 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606171    2581 scope.go:117] "RemoveContainer" containerID="68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"
Aug 05 06:05:58.606382 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:05:58.606368    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89\": container with ID starting with 68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89 not found: ID does not exist" containerID="68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"
Aug 05 06:05:58.606426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606387    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89"} err="failed to get container status \"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89\": rpc error: code = NotFound desc = could not find container \"68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89\": container with ID starting with 68a569d85624c88ec51245b7b162765f341e8df8826db9374b8a5885ce477f89 not found: ID does not exist"
Aug 05 06:05:58.606426 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606398    2581 scope.go:117] "RemoveContainer" containerID="37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"
Aug 05 06:05:58.606611 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:05:58.606590    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d\": container with ID starting with 37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d not found: ID does not exist" containerID="37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"
Aug 05 06:05:58.606655 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606615    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d"} err="failed to get container status \"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d\": rpc error: code = NotFound desc = could not find container \"37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d\": container with ID starting with 37e7d99612c4e3a183a22e1de267b3021cd37cfa0874d756164a5a99ce4aca5d not found: ID does not exist"
Aug 05 06:05:58.606655 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606628    2581 scope.go:117] "RemoveContainer" containerID="0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"
Aug 05 06:05:58.606819 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:05:58.606805    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47\": container with ID starting with 0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47 not found: ID does not exist" containerID="0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"
Aug 05 06:05:58.606866 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.606823    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47"} err="failed to get container status \"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47\": rpc error: code = NotFound desc = could not find container \"0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47\": container with ID starting with 0ddd96dfb248d7587342a665f96e5cc4e5014b2b4dfafb25ecf748c16431ee47 not found: ID does not exist"
Aug 05 06:05:58.639901 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639871    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a3569472-2f42-4f06-b6be-1afea1de11f9-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:58.639901 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639893    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:58.640058 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639922    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:58.640058 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639931    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a3569472-2f42-4f06-b6be-1afea1de11f9-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:58.640058 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639938    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a3569472-2f42-4f06-b6be-1afea1de11f9-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:58.640058 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:58.639966    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pgwq\" (UniqueName: \"kubernetes.io/projected/a3569472-2f42-4f06-b6be-1afea1de11f9-kube-api-access-7pgwq\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.004724 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.004697    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:05:59.043092 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043064    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043264 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tll8r\" (UniqueName: \"kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043264 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043408 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043270    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043408 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043408 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls\") pod \"031ceb11-1cec-465d-99f3-40c81f90b950\" (UID: \"031ceb11-1cec-465d-99f3-40c81f90b950\") "
Aug 05 06:05:59.043876 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.043842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data" (OuterVolumeSpecName: "feast-data") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:05:59.045379 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.045336    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r" (OuterVolumeSpecName: "kube-api-access-tll8r") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "kube-api-access-tll8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:05:59.045379 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.045370    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:59.045635 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.045613    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:59.045635 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.045626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls" (OuterVolumeSpecName: "online-tls") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:59.045876 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.045854    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "031ceb11-1cec-465d-99f3-40c81f90b950" (UID: "031ceb11-1cec-465d-99f3-40c81f90b950"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144212    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tll8r\" (UniqueName: \"kubernetes.io/projected/031ceb11-1cec-465d-99f3-40c81f90b950-kube-api-access-tll8r\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144245    2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-online-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144254    2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-ui-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144264    2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/031ceb11-1cec-465d-99f3-40c81f90b950-feast-data\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144273    2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-offline-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.144307 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.144280    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/031ceb11-1cec-465d-99f3-40c81f90b950-registry-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:05:59.241840 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.241798    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" path="/var/lib/kubelet/pods/a3569472-2f42-4f06-b6be-1afea1de11f9/volumes"
Aug 05 06:05:59.575779 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.575743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4" event={"ID":"031ceb11-1cec-465d-99f3-40c81f90b950","Type":"ContainerDied","Data":"ad5944f437f8f58f07962e8f469d09b9e2de2294c78d26398d3ef3a5ce93517f"}
Aug 05 06:05:59.576246 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.575795    2581 scope.go:117] "RemoveContainer" containerID="a80da04bef559a4db8e2ac83f8441e166a0c0c1916019a4c1fe2c709c7519a35"
Aug 05 06:05:59.576246 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.575795    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"
Aug 05 06:05:59.584697 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.584676    2581 scope.go:117] "RemoveContainer" containerID="b85db593d9770c03a71141627a0b85269eba3add6ffb94bcec6829e607419bd9"
Aug 05 06:05:59.592044 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.592022    2581 scope.go:117] "RemoveContainer" containerID="6d287b0d851d5883734872cbf93adbad7dea3164c98ca41e9c3902b24a7492d2"
Aug 05 06:05:59.597103 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.596218    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:05:59.599226 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.599204    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rz7d4"]
Aug 05 06:05:59.600794 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.600781    2581 scope.go:117] "RemoveContainer" containerID="4c34a63893c6a99b8b67f1f71f74d9bab86d2047a7c44a0dd72722be6275dc62"
Aug 05 06:05:59.607990 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.607973    2581 scope.go:117] "RemoveContainer" containerID="b97b09546e1b5d0ba90b30d42a39d9cd6a115e986dd329ced1c4880ecf159ba4"
Aug 05 06:05:59.614818 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:05:59.614786    2581 scope.go:117] "RemoveContainer" containerID="5671baecf2e732761ae2f11c5953ab148e636168e3886f432fd29fe3aee51083"
Aug 05 06:06:01.241117 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:01.241084    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" path="/var/lib/kubelet/pods/031ceb11-1cec-465d-99f3-40c81f90b950/volumes"
Aug 05 06:06:17.499998 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.499961    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mj85/must-gather-h56ql"]
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500233    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500244    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500254    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="feast-apply"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="feast-apply"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500267    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="registry"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500273    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="registry"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500279    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500284    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500290    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500296    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500307    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500312    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500325    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500330    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500336    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="feast-init"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500341    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="feast-init"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500347    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500351    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500358    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="feast-apply"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="feast-apply"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500370    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="feast-init"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500375    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="feast-init"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500417    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="registry"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500424    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500431    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="ui"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500436    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="online"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500443    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500449    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="031ceb11-1cec-465d-99f3-40c81f90b950" containerName="offline"
Aug 05 06:06:17.500448 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.500456    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3569472-2f42-4f06-b6be-1afea1de11f9" containerName="online"
Aug 05 06:06:17.505749 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.505727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.508567 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.508534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mj85\"/\"openshift-service-ca.crt\""
Aug 05 06:06:17.508695 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.508681    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mj85\"/\"kube-root-ca.crt\""
Aug 05 06:06:17.509133 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.509118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6mj85\"/\"default-dockercfg-n748d\""
Aug 05 06:06:17.511021 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.511001    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mj85/must-gather-h56ql"]
Aug 05 06:06:17.587718 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.587681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvc4\" (UniqueName: \"kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.587718 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.587720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.688933 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.688904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.689124 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.689006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvc4\" (UniqueName: \"kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.689257 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.689238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.697572 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.697555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvc4\" (UniqueName: \"kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4\") pod \"must-gather-h56ql\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") " pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.825425 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.825349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:17.953692 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.953660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mj85/must-gather-h56ql"]
Aug 05 06:06:17.956561 ip-10-0-134-152 kubenswrapper[2581]: W0805 06:06:17.956533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e1ab270_689d_4cf6_88dd_b533c1856d2c.slice/crio-775a8ad094099bf22d9ea7a7e8bb088430010223d23f4097c04dbd6fa68e874c WatchSource:0}: Error finding container 775a8ad094099bf22d9ea7a7e8bb088430010223d23f4097c04dbd6fa68e874c: Status 404 returned error can't find the container with id 775a8ad094099bf22d9ea7a7e8bb088430010223d23f4097c04dbd6fa68e874c
Aug 05 06:06:17.958332 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:17.958313    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 06:06:18.651312 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:18.651272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mj85/must-gather-h56ql" event={"ID":"7e1ab270-689d-4cf6-88dd-b533c1856d2c","Type":"ContainerStarted","Data":"775a8ad094099bf22d9ea7a7e8bb088430010223d23f4097c04dbd6fa68e874c"}
Aug 05 06:06:24.680500 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:24.680466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mj85/must-gather-h56ql" event={"ID":"7e1ab270-689d-4cf6-88dd-b533c1856d2c","Type":"ContainerStarted","Data":"28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486"}
Aug 05 06:06:24.680908 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:24.680512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mj85/must-gather-h56ql" event={"ID":"7e1ab270-689d-4cf6-88dd-b533c1856d2c","Type":"ContainerStarted","Data":"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"}
Aug 05 06:06:24.696863 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:24.696813    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6mj85/must-gather-h56ql" podStartSLOduration=1.721561507 podStartE2EDuration="7.6967973s" totalImagesPullingTime="5.975235793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 06:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 06:06:24.695520996 +0000 UTC m=+1828.105179943" watchObservedRunningTime="2026-08-05 06:06:24.6967973 +0000 UTC m=+1828.106456249"
Aug 05 06:06:33.716604 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:33.716571    2581 generic.go:356] "Generic (PLEG): container finished" podID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerID="a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75" exitCode=0
Aug 05 06:06:33.717018 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:33.716608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mj85/must-gather-h56ql" event={"ID":"7e1ab270-689d-4cf6-88dd-b533c1856d2c","Type":"ContainerDied","Data":"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"}
Aug 05 06:06:33.717018 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:33.716881    2581 scope.go:117] "RemoveContainer" containerID="a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"
Aug 05 06:06:34.685723 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:34.685692    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6mj85_must-gather-h56ql_7e1ab270-689d-4cf6-88dd-b533c1856d2c/gather/0.log"
Aug 05 06:06:37.798751 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:37.798712    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9cdl2_3fc3f4c8-4d7f-4b98-b181-1cac250ce75d/global-pull-secret-syncer/0.log"
Aug 05 06:06:37.964775 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:37.964742    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hcrkv_f7cb10bf-2662-40a6-9fdc-de398cdc4184/konnectivity-agent/0.log"
Aug 05 06:06:38.069064 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:38.068977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-152.ec2.internal_98f5034d73fabec3b6e22ad6386ac3fa/haproxy/0.log"
Aug 05 06:06:39.994078 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:39.994042    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6mj85/must-gather-h56ql"]
Aug 05 06:06:39.994471 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:39.994213    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6mj85/must-gather-h56ql" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="copy" containerID="cri-o://28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486" gracePeriod=2
Aug 05 06:06:39.998319 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:39.998222    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6mj85/must-gather-h56ql"]
Aug 05 06:06:40.221168 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.221147    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6mj85_must-gather-h56ql_7e1ab270-689d-4cf6-88dd-b533c1856d2c/copy/0.log"
Aug 05 06:06:40.222648 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.222631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:40.224314 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:06:40.224291    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h56ql\" is forbidden: User \"system:node:ip-10-0-134-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6mj85\": no relationship found between node 'ip-10-0-134-152.ec2.internal' and this object" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:40.381899 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.381810    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output\") pod \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") "
Aug 05 06:06:40.381899 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.381853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgvc4\" (UniqueName: \"kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4\") pod \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\" (UID: \"7e1ab270-689d-4cf6-88dd-b533c1856d2c\") "
Aug 05 06:06:40.382234 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.382209    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "7e1ab270-689d-4cf6-88dd-b533c1856d2c" (UID: "7e1ab270-689d-4cf6-88dd-b533c1856d2c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 06:06:40.384028 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.383993    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4" (OuterVolumeSpecName: "kube-api-access-bgvc4") pod "7e1ab270-689d-4cf6-88dd-b533c1856d2c" (UID: "7e1ab270-689d-4cf6-88dd-b533c1856d2c"). InnerVolumeSpecName "kube-api-access-bgvc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 06:06:40.482673 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.482644    2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7e1ab270-689d-4cf6-88dd-b533c1856d2c-must-gather-output\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:06:40.482673 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.482668    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgvc4\" (UniqueName: \"kubernetes.io/projected/7e1ab270-689d-4cf6-88dd-b533c1856d2c-kube-api-access-bgvc4\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Aug 05 06:06:40.744033 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.744007    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6mj85_must-gather-h56ql_7e1ab270-689d-4cf6-88dd-b533c1856d2c/copy/0.log"
Aug 05 06:06:40.744381 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.744359    2581 generic.go:356] "Generic (PLEG): container finished" podID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerID="28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486" exitCode=143
Aug 05 06:06:40.744468 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.744405    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:40.744518 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.744408    2581 scope.go:117] "RemoveContainer" containerID="28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486"
Aug 05 06:06:40.746315 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:06:40.746281    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h56ql\" is forbidden: User \"system:node:ip-10-0-134-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6mj85\": no relationship found between node 'ip-10-0-134-152.ec2.internal' and this object" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:40.752172 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.752157    2581 scope.go:117] "RemoveContainer" containerID="a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"
Aug 05 06:06:40.754124 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:06:40.754089    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h56ql\" is forbidden: User \"system:node:ip-10-0-134-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6mj85\": no relationship found between node 'ip-10-0-134-152.ec2.internal' and this object" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" pod="openshift-must-gather-6mj85/must-gather-h56ql"
Aug 05 06:06:40.763375 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.763359    2581 scope.go:117] "RemoveContainer" containerID="28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486"
Aug 05 06:06:40.763599 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:06:40.763580    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486\": container with ID starting with 28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486 not found: ID does not exist" containerID="28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486"
Aug 05 06:06:40.763671 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.763612    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486"} err="failed to get container status \"28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486\": rpc error: code = NotFound desc = could not find container \"28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486\": container with ID starting with 28895c370b451a08875fe31b7c538b3709b4148635c44a637ec1c9b05cf8b486 not found: ID does not exist"
Aug 05 06:06:40.763671 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.763636    2581 scope.go:117] "RemoveContainer" containerID="a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"
Aug 05 06:06:40.763859 ip-10-0-134-152 kubenswrapper[2581]: E0805 06:06:40.763843    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75\": container with ID starting with a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75 not found: ID does not exist" containerID="a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"
Aug 05 06:06:40.763899 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:40.763865    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75"} err="failed to get container status \"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75\": rpc error: code = NotFound desc = could not find container \"a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75\": container with ID starting with a7292866cef63cdec91942d60b2c08c6c09a62d62a5f5acf40ec436759abfd75 not found: ID does not exist"
Aug 05 06:06:41.240791 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:41.240760    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" path="/var/lib/kubelet/pods/7e1ab270-689d-4cf6-88dd-b533c1856d2c/volumes"
Aug 05 06:06:41.846688 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:41.846654    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-k9rq7_61856c73-7729-4624-a8be-aa2d2fece968/kube-state-metrics/0.log"
Aug 05 06:06:41.868911 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:41.868887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-k9rq7_61856c73-7729-4624-a8be-aa2d2fece968/kube-rbac-proxy-main/0.log"
Aug 05 06:06:41.894554 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:41.894491    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-k9rq7_61856c73-7729-4624-a8be-aa2d2fece968/kube-rbac-proxy-self/0.log"
Aug 05 06:06:41.960009 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:41.959986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-4d7gh_3bdaf09b-5488-4050-96a8-89eed70fa292/monitoring-plugin/0.log"
Aug 05 06:06:42.230310 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.230286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qs2h2_47ace3ef-2f29-495d-beb9-385644381b46/node-exporter/0.log"
Aug 05 06:06:42.255827 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.255801    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qs2h2_47ace3ef-2f29-495d-beb9-385644381b46/kube-rbac-proxy/0.log"
Aug 05 06:06:42.280584 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.280558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qs2h2_47ace3ef-2f29-495d-beb9-385644381b46/init-textfile/0.log"
Aug 05 06:06:42.782656 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.782627    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/thanos-query/0.log"
Aug 05 06:06:42.806009 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.805981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/kube-rbac-proxy-web/0.log"
Aug 05 06:06:42.832255 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.832235    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/kube-rbac-proxy/0.log"
Aug 05 06:06:42.863312 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.863291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/prom-label-proxy/0.log"
Aug 05 06:06:42.891115 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.891090    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/kube-rbac-proxy-rules/0.log"
Aug 05 06:06:42.916084 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:42.916064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74bb5d789f-jh9gp_4da20ad9-dbf6-4c14-b4a3-26d8a0ccaf44/kube-rbac-proxy-metrics/0.log"
Aug 05 06:06:44.093551 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:44.093512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-bz9x2_a98b470c-b616-42e8-9672-bac000436b06/networking-console-plugin/0.log"
Aug 05 06:06:44.942545 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:44.942516    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-2kmvb_a7d0e4cf-1b7e-4a7c-bcb1-c0608ea346a0/download-server/0.log"
Aug 05 06:06:45.206471 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206394    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"]
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206694    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="gather"
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206706    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="gather"
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206714    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="copy"
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206719    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="copy"
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206772    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="gather"
Aug 05 06:06:45.206847 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.206782    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1ab270-689d-4cf6-88dd-b533c1856d2c" containerName="copy"
Aug 05 06:06:45.210121 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.210102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.218425 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.218405    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qv2n7\"/\"openshift-service-ca.crt\""
Aug 05 06:06:45.219068 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.219049    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qv2n7\"/\"kube-root-ca.crt\""
Aug 05 06:06:45.221361 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.221341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qv2n7\"/\"default-dockercfg-lnhrt\""
Aug 05 06:06:45.305932 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.305910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"]
Aug 05 06:06:45.321781 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.321755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghxzv\" (UniqueName: \"kubernetes.io/projected/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-kube-api-access-ghxzv\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.321886 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.321786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-lib-modules\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.321886 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.321813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-podres\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.321886 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.321837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-sys\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.322026 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.321881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-proc\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422783 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-sys\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422913 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-proc\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422913 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghxzv\" (UniqueName: \"kubernetes.io/projected/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-kube-api-access-ghxzv\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422913 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-lib-modules\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422913 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-sys\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.422913 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-proc\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.423127 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.422931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-podres\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.423127 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.423005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-lib-modules\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.423127 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.423082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-podres\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.430526 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.430510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghxzv\" (UniqueName: \"kubernetes.io/projected/d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd-kube-api-access-ghxzv\") pod \"perf-node-gather-daemonset-kzffw\" (UID: \"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd\") " pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.519446 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.519413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.645712 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.645684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"]
Aug 05 06:06:45.649124 ip-10-0-134-152 kubenswrapper[2581]: W0805 06:06:45.649091    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd93f5a2a_7c6b_4f94_9f8a_bbbae58e05cd.slice/crio-d6258fa302782e394af7498b17266003a51efa1f8bb059a6a78eb2a959556614 WatchSource:0}: Error finding container d6258fa302782e394af7498b17266003a51efa1f8bb059a6a78eb2a959556614: Status 404 returned error can't find the container with id d6258fa302782e394af7498b17266003a51efa1f8bb059a6a78eb2a959556614
Aug 05 06:06:45.765172 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.765141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw" event={"ID":"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd","Type":"ContainerStarted","Data":"66b135c0c8b1835c2af960be0d92c205519059e359fe09f0855af91c511f3592"}
Aug 05 06:06:45.765274 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.765198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw" event={"ID":"d93f5a2a-7c6b-4f94-9f8a-bbbae58e05cd","Type":"ContainerStarted","Data":"d6258fa302782e394af7498b17266003a51efa1f8bb059a6a78eb2a959556614"}
Aug 05 06:06:45.765274 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.765225    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:45.781528 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:45.781459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw" podStartSLOduration=0.781444943 podStartE2EDuration="781.444943ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 06:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 06:06:45.780206143 +0000 UTC m=+1849.189865090" watchObservedRunningTime="2026-08-05 06:06:45.781444943 +0000 UTC m=+1849.191103891"
Aug 05 06:06:46.287274 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:46.287250    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htl9b_40d88b81-cd88-450d-b900-fa18ac50a693/dns/0.log"
Aug 05 06:06:46.306927 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:46.306903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htl9b_40d88b81-cd88-450d-b900-fa18ac50a693/kube-rbac-proxy/0.log"
Aug 05 06:06:46.370886 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:46.370862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9pgbw_4fc0f4e6-a22f-4087-a11a-dde36d4c22e6/dns-node-resolver/0.log"
Aug 05 06:06:46.840118 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:46.840090    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5brmv_21ed34a4-0787-4540-8e68-9e60e18b794d/node-ca/0.log"
Aug 05 06:06:47.585457 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:47.585423    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-fffdc8c78-5j4zb_e44da256-f1f0-432b-8f5d-3b60c06fbd2b/router/0.log"
Aug 05 06:06:47.964795 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:47.964711    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vtk9x_14dfc461-68c5-42bd-b52e-77089576ba07/serve-healthcheck-canary/0.log"
Aug 05 06:06:48.302688 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:48.302656    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-x2dgc_7a57edde-4f0e-4e0f-af84-55647db789bc/insights-operator/0.log"
Aug 05 06:06:48.303004 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:48.302981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-x2dgc_7a57edde-4f0e-4e0f-af84-55647db789bc/insights-operator/1.log"
Aug 05 06:06:48.395903 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:48.395874    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6fm_ebc321d6-1b0b-4b47-ab06-361771aa1257/kube-rbac-proxy/0.log"
Aug 05 06:06:48.411244 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:48.411215    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6fm_ebc321d6-1b0b-4b47-ab06-361771aa1257/exporter/0.log"
Aug 05 06:06:48.432232 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:48.432206    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6fm_ebc321d6-1b0b-4b47-ab06-361771aa1257/extractor/0.log"
Aug 05 06:06:51.778797 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:51.778769    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qv2n7/perf-node-gather-daemonset-kzffw"
Aug 05 06:06:54.003836 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.003803    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/kube-multus-additional-cni-plugins/0.log"
Aug 05 06:06:54.026132 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.026107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/egress-router-binary-copy/0.log"
Aug 05 06:06:54.048789 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.048714    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/cni-plugins/0.log"
Aug 05 06:06:54.071557 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.071533    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/bond-cni-plugin/0.log"
Aug 05 06:06:54.094545 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.094507    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/routeoverride-cni/0.log"
Aug 05 06:06:54.116879 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.116847    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/whereabouts-cni-bincopy/0.log"
Aug 05 06:06:54.138310 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.138284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-htts4_cd276d1c-739b-441a-862c-d8e0f9931d69/whereabouts-cni/0.log"
Aug 05 06:06:54.375123 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.375098    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ml2pt_59ade31a-4ad8-4564-87c1-d6e4dcda15d3/kube-multus/0.log"
Aug 05 06:06:54.424499 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.424458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-47xz4_8d5d27ff-1728-4820-a619-935ef6094cd9/network-metrics-daemon/0.log"
Aug 05 06:06:54.445154 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:54.445133    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-47xz4_8d5d27ff-1728-4820-a619-935ef6094cd9/kube-rbac-proxy/0.log"
Aug 05 06:06:55.275395 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.275364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/ovn-controller/0.log"
Aug 05 06:06:55.290267 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.290241    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/ovn-acl-logging/0.log"
Aug 05 06:06:55.316849 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.316824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/kube-rbac-proxy-node/0.log"
Aug 05 06:06:55.338539 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.338513    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/kube-rbac-proxy-ovn-metrics/0.log"
Aug 05 06:06:55.353966 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.353923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/northd/0.log"
Aug 05 06:06:55.374584 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.374561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/nbdb/0.log"
Aug 05 06:06:55.397207 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.397187    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/sbdb/0.log"
Aug 05 06:06:55.455276 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:55.455238    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26cn6_b994f761-fea3-41b7-a35d-79a4fbc40cc0/ovnkube-controller/0.log"
Aug 05 06:06:56.868543 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:56.868508    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-65bdbbff45-7fxm9_bbbb58c5-ab6e-4548-bedd-d0b6053d4e0c/check-endpoints/0.log"
Aug 05 06:06:56.946772 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:56.946742    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fdw26_9eab6a52-c405-459b-9e7f-69fd9b6095ba/network-check-target-container/0.log"
Aug 05 06:06:57.806501 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:57.806410    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9ntns_805c01e7-c721-410e-a13a-09bd4987a46c/iptables-alerter/0.log"
Aug 05 06:06:58.500667 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:06:58.500638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sx8xw_49950f58-2f12-4c00-b94f-73619af12961/tuned/0.log"
Aug 05 06:07:01.157316 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:07:01.157284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-784f97bcf6-pxxvp_bae5b21c-f10b-4f75-bc55-370509f0c111/service-ca-operator/1.log"
Aug 05 06:07:01.158983 ip-10-0-134-152 kubenswrapper[2581]: I0805 06:07:01.158941    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-784f97bcf6-pxxvp_bae5b21c-f10b-4f75-bc55-370509f0c111/service-ca-operator/0.log"