Jul 07 16:37:12.198736 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 16:37:12.198746 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 16:37:12.198756 ip-10-0-128-52 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 16:37:12.199091 ip-10-0-128-52 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 16:37:22.208119 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 16:37:22.208133 ip-10-0-128-52 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6a324bb200fa49e8bec62a3d804c1822 --
Jul 07 16:39:11.875684 ip-10-0-128-52 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 16:39:12.297867 ip-10-0-128-52 systemd[1]: Started Kubernetes Kubelet.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.223275    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230466    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230485    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230490    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230495    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230500    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230504    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230508    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.312517 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230512    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230516    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230520    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230529    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230534    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230543    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230549    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230555    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230559    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230564    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230568    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230573    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230577    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230583    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230587    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230591    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230595    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230604    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230608    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.313478 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230612    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230616    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230619    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230623    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230627    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230632    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230637    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230642    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230645    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230649    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230657    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230661    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230665    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230669    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230673    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230677    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230681    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230685    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230688    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230692    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.314780 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230697    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230700    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230705    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230714    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230718    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230722    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230725    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230731    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230737    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230741    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230745    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230750    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230754    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230759    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230762    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230770    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230774    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230778    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230783    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230787    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.315875 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230792    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230795    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230799    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230803    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230817    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230821    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230825    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230832    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230837    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230841    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230845    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230849    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230853    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230858    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230862    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230866    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230870    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230874    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230878    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.316889 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230887    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230891    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230895    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230899    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230903    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230908    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230914    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230919    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230923    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230927    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230931    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230935    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230944    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.230948    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232637    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232646    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232656    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232660    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232666    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232671    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.317660 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232675    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232679    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232683    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232689    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232696    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232701    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232705    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232710    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232719    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232723    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232728    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232736    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232740    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232745    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232749    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232753    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232758    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232761    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232765    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.318674 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232769    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232773    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232781    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232785    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232789    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232793    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232797    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232801    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232805    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232809    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232813    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232817    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232821    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232825    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232833    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232837    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232842    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232847    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232850    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.319290 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232857    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232863    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232867    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232872    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232876    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232880    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232884    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232892    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232896    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232900    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232903    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232907    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232911    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232915    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232919    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232923    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232927    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232930    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232935    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232939    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.319914 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232947    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232951    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232955    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232959    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232963    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232966    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232970    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232975    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232979    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232984    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232988    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232992    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.232996    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233003    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233007    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233012    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233015    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233019    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233023    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233028    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.320527 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233032    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233036    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233040    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233050    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233059    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233063    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233067    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233075    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233079    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233084    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233087    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233092    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233096    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233101    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.233105    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234034    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234042    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234046    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234051    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.321211 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234055    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234059    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234068    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234072    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234076    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234080    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234084    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234089    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234093    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234097    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234101    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234106    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234110    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234114    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234122    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234127    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234134    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234139    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234145    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234150    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.322286 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234162    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234166    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234169    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234174    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234178    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234182    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234188    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234196    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234202    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234207    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234211    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234214    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234218    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234222    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234226    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234230    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234234    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234238    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234242    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234249    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.323380 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234253    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234257    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234262    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234267    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234271    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234275    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234279    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234283    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234287    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234291    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234295    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234302    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234309    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234317    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234320    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234325    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234329    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234332    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234336    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234340    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.324087 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234344    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234348    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234352    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234360    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234364    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234369    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234373    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234380    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234385    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234389    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234394    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234410    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234415    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234419    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234423    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234431    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234436    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234440    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234444    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.324918 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234447    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234451    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234455    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234459    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234463    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234469    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234473    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234476    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234481    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234488    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234492    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234496    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234501    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234505    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234509    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.234514    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234637    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234646    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234654    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234660    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234667    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 16:39:12.325526 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234672    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234678    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234684    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234693    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234698    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234703    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234709    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234714    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234719    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234724    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234729    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234737    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234742    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234748    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234752    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234757    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234764    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234770    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234776    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234782    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234795    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234801    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234806    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234810    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 16:39:12.326342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234815    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234821    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234825    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234832    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234840    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234845    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234849    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234853    2565 flags.go:64] FLAG: --enable-server="true"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234858    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234863    2565 flags.go:64] FLAG: --event-burst="100"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234868    2565 flags.go:64] FLAG: --event-qps="50"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234873    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234878    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234886    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234892    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234897    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234901    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234907    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234911    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234916    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234920    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234928    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234932    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234937    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234948    2565 flags.go:64] FLAG: --feature-gates=""
Jul 07 16:39:12.327160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234954    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234959    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234964    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234968    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234976    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234981    2565 flags.go:64] FLAG: --help="false"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234986    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234991    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.234995    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235000    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235006    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235011    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235016    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235023    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235028    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235032    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235037    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235041    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235046    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235050    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235059    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235067    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235072    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235077    2565 flags.go:64] FLAG: --lock-file=""
Jul 07 16:39:12.327995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235081    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235085    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235090    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235103    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235107    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235112    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235120    2565 flags.go:64] FLAG: --logging-format="text"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235126    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235131    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235136    2565 flags.go:64] FLAG: --manifest-url=""
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235141    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235147    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235152    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235159    2565 flags.go:64] FLAG: --max-pods="110"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235168    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235172    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235177    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235181    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235186    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235192    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235197    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235211    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235216    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235221    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 16:39:12.328997 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235226    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235230    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235238    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235243    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235249    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235253    2565 flags.go:64] FLAG: --port="10250"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235267    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235271    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0687305829a32ab8b"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235276    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235281    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235285    2565 flags.go:64] FLAG: --register-node="true"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235290    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235295    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235300    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235307    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235312    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235319    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235324    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235329    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235333    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235337    2565 flags.go:64] FLAG: --runonce="false"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235342    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235351    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235355    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235360    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 16:39:12.446923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235364    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235369    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235374    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235378    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235383    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235388    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235396    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235418    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235423    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235427    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235432    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235443    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235448    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235456    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235462    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235466    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235471    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235476    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235481    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235486    2565 flags.go:64] FLAG: --v="2"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235492    2565 flags.go:64] FLAG: --version="false"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235501    2565 flags.go:64] FLAG: --vmodule=""
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235507    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.235513    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235826    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.476244 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235831    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235836    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235840    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235844    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235849    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235853    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235857    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235862    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235866    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235874    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235879    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235883    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235887    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235891    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235895    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235899    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235902    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235907    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235912    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235916    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.477271 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235920    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235928    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235932    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235936    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235940    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235944    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235948    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235951    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235956    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235959    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235965    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235969    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235973    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235977    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235985    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235989    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235993    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.235997    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236001    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236005    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.477965 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236009    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236013    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236016    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236024    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236029    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236032    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236045    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236049    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236053    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236057    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236062    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236066    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236070    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236075    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236081    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236087    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236091    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236095    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236099    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236108    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.478683 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236111    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236115    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236121    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236125    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236129    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236134    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236137    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236141    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236145    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236149    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236153    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236161    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236165    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236168    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236172    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236176    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236181    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236185    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236189    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.479302 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236193    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236197    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236201    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236206    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236209    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236217    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236221    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236225    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236229    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236233    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236236    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236240    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236246    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236251    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236256    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236263    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236267    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236273    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.480261 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.236282    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.236290    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.244394    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.244422    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.244436    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.244445    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244501    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244506    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244509    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244512    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244514    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244517    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244520    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244523    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244525    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.481165 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244530    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244533    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244536    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244539    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244542    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244544    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244547    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244550    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244553    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244555    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244557    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244560    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244562    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244565    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244568    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244570    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244573    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244576    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244578    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244582    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.481948 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244586    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244589    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244592    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244595    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244598    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244600    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244603    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244606    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244609    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244611    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244616    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244618    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244621    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244624    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244627    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244629    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244632    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244634    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244637    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.482870 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244639    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244643    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244647    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244650    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244652    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244655    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244657    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244660    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244663    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244666    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244669    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244671    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244674    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244677    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244680    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244683    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244685    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244688    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244690    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.483663 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244693    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244695    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244698    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244700    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244705    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244707    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244710    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244712    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244715    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244717    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244720    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244722    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244725    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244728    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244730    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244733    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244736    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244738    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244741    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.484204 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244743    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244747    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244751    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244754    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244757    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244759    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244762    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244766    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244769    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244772    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244775    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244779    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.244784    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244901    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:39:12.484803 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244906    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244909    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244912    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244916    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244919    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244922    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244925    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244928    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244930    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244934    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244937    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244940    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244943    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244946    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244949    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244952    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244954    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244957    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244960    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:39:12.485235 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244962    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244965    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244967    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244971    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244973    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244976    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244978    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244982    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244984    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244986    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244989    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244991    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244994    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244996    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.244999    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245002    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245005    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245008    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245011    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245013    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:39:12.485874 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245015    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245018    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245021    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245023    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245025    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245028    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245030    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245033    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245037    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245040    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245042    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245045    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245047    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245050    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245052    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245055    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245058    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245061    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245063    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245067    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:39:12.486415 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245069    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245072    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245074    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245077    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245079    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245082    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245084    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245087    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245090    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245092    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245095    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245097    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245100    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245103    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245105    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245108    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245110    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245113    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245115    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245118    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:39:12.486988 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245120    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245123    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245125    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245128    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245130    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245133    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245135    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245137    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245140    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245143    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245146    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245150    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245152    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245155    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245157    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245161    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245164    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245167    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:39:12.487599 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:12.245169    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.245174    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.245274    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.247317    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.248568    2565 server.go:1019] "Starting client certificate rotation"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.248669    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.248705    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.250758    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.252055    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.262395    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.264500    2565 log.go:25] "Validated CRI v1 image API"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.268025    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 16:39:12.488218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.270105    2565 fs.go:135] Filesystem UUIDs: map[11140e29-7d04-4138-bfc1-27c029060eac:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9ae6ae80-07a9-40d9-ab26-ca9881c7a988:/dev/nvme0n1p3]
Jul 07 16:39:12.488637 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.270130    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.276781    2565 manager.go:216] Machine: {Timestamp:2026-07-07 16:39:12.275132205 +0000 UTC m=+0.292108203 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101308 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e9d9591631ae8d85499e2a5503acf SystemUUID:ec2e9d95-9163-1ae8-d854-99e2a5503acf BootID:6a324bb2-00fa-49e8-bec6-2a3d804c1822 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:29:8c:11:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:29:8c:11:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:f7:a8:72:18:b2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.276989    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.277093    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.280235    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.280265    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.281563    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.281575    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 16:39:12.488848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.281583    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.282162    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.283465    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.285446    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287391    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287528    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287554    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287567    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287581    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287591    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287600    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287940    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.287955    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.289725    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.291760    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.291787    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292807    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292820    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292826    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292832    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292841    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292847    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292854    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292859    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292865    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292871    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292878    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.292883    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.293566    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.293578    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.296948    2565 server.go:1268] "Started kubelet"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.296999    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.297062    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.297132    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.298736    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.299901    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.299913    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.300383    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.300447    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 16:39:12.618072 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.303212    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.303674    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-52.ec2.internal.18c00f5ece09e6f9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-52.ec2.internal,UID:ip-10-0-128-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-52.ec2.internal,},FirstTimestamp:2026-07-07 16:39:12.296814329 +0000 UTC m=+0.313790327,LastTimestamp:2026-07-07 16:39:12.296814329 +0000 UTC m=+0.313790327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-52.ec2.internal,}"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.305594    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.305639    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.305723    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306265    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306280    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306287    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306322    2565 factory.go:55] Registering systemd factory
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306337    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306421    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306429    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306510    2565 factory.go:153] Registering CRI-O factory
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306520    2565 factory.go:223] Registration of the crio container factory successfully
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306565    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306587    2565 factory.go:103] Registering Raw factory
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.306611    2565 manager.go:1196] Started watching for new ooms in manager
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.307738    2565 manager.go:349] Starting recovery of all containers
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.312595    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.312730    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.313674    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.323143    2565 manager.go:354] Recovery completed
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.327507    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329314    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329357    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329370    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329809    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329818    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329833    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.329871    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.330672    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.330699    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.619284 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.330711    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.331658    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-52.ec2.internal.18c00f5ecffa33c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-52.ec2.internal,UID:ip-10-0-128-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-52.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-52.ec2.internal,},FirstTimestamp:2026-07-07 16:39:12.329339849 +0000 UTC m=+0.346315854,LastTimestamp:2026-07-07 16:39:12.329339849 +0000 UTC m=+0.346315854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-52.ec2.internal,}"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.332078    2565 policy_none.go:49] "None policy: Start"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.332091    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.332102    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.334068    2565 policy_none.go:47] "Start"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.334264    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6459"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.340954    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-52.ec2.internal.18c00f5ecffa8f82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-52.ec2.internal,UID:ip-10-0-128-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-52.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-52.ec2.internal,},FirstTimestamp:2026-07-07 16:39:12.32936333 +0000 UTC m=+0.346339328,LastTimestamp:2026-07-07 16:39:12.32936333 +0000 UTC m=+0.346339328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-52.ec2.internal,}"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.342377    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6459"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.378977    2565 manager.go:337] "Starting Device Plugin manager"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.379005    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379016    2565 server.go:87] "Starting device plugin registration server"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379262    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379275    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379447    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379561    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.379570    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.379932    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.379979    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.479346    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.479711    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.479757    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.479778    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.479812    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.480740    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.480780    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.480804    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621183 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.480838    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.483044    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.491307    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.491327    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-52.ec2.internal\": node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.550916    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.580715    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"]
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.580803    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.581642    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.581669    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.581678    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.583881    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584041    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584554    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584555    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584578    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584587    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584593    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.584597    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.586709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.586728    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.587304    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.587321    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.587334    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.608475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.608497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:12.621961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:12.608520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb5189a869022cef34eed256cb1ca3a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"fb5189a869022cef34eed256cb1ca3a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.623956    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-52.ec2.internal\" not found" node="ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.627237    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-52.ec2.internal\" not found" node="ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:12.651616    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb5189a869022cef34eed256cb1ca3a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"fb5189a869022cef34eed256cb1ca3a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/299a87a4a45d9b26418fa6fd3ad1b8de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"299a87a4a45d9b26418fa6fd3ad1b8de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.720661    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb5189a869022cef34eed256cb1ca3a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"fb5189a869022cef34eed256cb1ca3a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:13.774841 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:13.763685    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:13.937059 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:13.864307    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.047941 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.939025    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:14.047941 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:13.942166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:14.047941 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:13.964764    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.224311 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:14.065529    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.224311 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:14.166020    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.326364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.245848    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:14.326364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.259225    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 16:39:14.326364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.259350    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:39:14.326364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.259377    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:39:14.326364 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:14.266479    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.468394 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.356753    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:34:13 +0000 UTC" deadline="2028-02-28 05:31:17.073806903 +0000 UTC"
Jul 07 16:39:14.468394 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.356787    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14412h52m2.717023814s"
Jul 07 16:39:14.468394 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:14.367393    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.468394 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:14.468034    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 07 16:39:14.579961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.521711    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:39:14.579961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.522716    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:39:14.579961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.522751    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:39:14.579961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.522766    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:39:14.579961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.546167    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.618195    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.627826    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.628923    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.645357    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:14.649049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5189a869022cef34eed256cb1ca3a3.slice/crio-5d94c9a202162392d471b7c1b42b53eed83668491e03c80b7fb1f773b4e0516d WatchSource:0}: Error finding container 5d94c9a202162392d471b7c1b42b53eed83668491e03c80b7fb1f773b4e0516d: Status 404 returned error can't find the container with id 5d94c9a202162392d471b7c1b42b53eed83668491e03c80b7fb1f773b4e0516d
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:14.649631    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299a87a4a45d9b26418fa6fd3ad1b8de.slice/crio-8237a44239880ea997e8aa359c0ab0407438c978232ecbdc75b24fb7b769090c WatchSource:0}: Error finding container 8237a44239880ea997e8aa359c0ab0407438c978232ecbdc75b24fb7b769090c: Status 404 returned error can't find the container with id 8237a44239880ea997e8aa359c0ab0407438c978232ecbdc75b24fb7b769090c
Jul 07 16:39:14.754130 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.653554    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:39:14.947288 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:14.883965    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:15.340150 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.300097    2565 apiserver.go:52] "Watching apiserver"
Jul 07 16:39:15.340150 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.318263    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 16:39:15.354852 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.354825    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 16:39:15.355339 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.355304    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-64mmh","openshift-ovn-kubernetes/ovnkube-node-vhccm","kube-system/global-pull-secret-syncer-mn7vv","kube-system/konnectivity-agent-2mj5d","kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2","openshift-cluster-node-tuning-operator/tuned-q7q2j","openshift-dns/node-resolver-5f6ts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal","openshift-multus/multus-additional-cni-plugins-ppglm","openshift-image-registry/node-ca-6nzd8","openshift-multus/multus-vppt7","openshift-multus/network-metrics-daemon-wrp9n","openshift-network-diagnostics/network-check-target-22ddz"]
Jul 07 16:39:15.357905 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.357884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.360400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.360382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.361204 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.361183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.361293 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.361217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbc8v\""
Jul 07 16:39:15.361739 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.361538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.362077 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.362055    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:39:15.363003 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.362983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.363112 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.363086    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:15.363464 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.363419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.363533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.363449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.364714 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.364286    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 16:39:15.364714 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.364508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pkkrb\""
Jul 07 16:39:15.365906 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.365889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.369211 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.369191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:15.369299 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.369257    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:15.371424 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.371404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.373661 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.373641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.374108 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.374093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 16:39:15.374227 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.374209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9kkpq\""
Jul 07 16:39:15.374328 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.374313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 16:39:15.374535 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.374518    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.374604 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.374521    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 16:39:15.375389 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.375371    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.375573 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.375556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rsml7\""
Jul 07 16:39:15.376067 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.376050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.376144 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.376113    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:15.376582 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.376567    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.378655 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.378637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.379639 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.379620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k95x9\""
Jul 07 16:39:15.379770 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.379753    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.381046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.381027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.381508 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.381486    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbpbr"
Jul 07 16:39:15.383445 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.383429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.383547 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.383456    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 16:39:15.384583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.384372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 16:39:15.384583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.384439    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.384583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.384498    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fnvdj\""
Jul 07 16:39:15.384583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.384547    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 16:39:15.385365 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385334    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.385544 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 16:39:15.385647 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.385835 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385756    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.385925 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385890    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 16:39:15.385996 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.385933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.392018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.391152    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tr7g2\""
Jul 07 16:39:15.392018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.391292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 16:39:15.392018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.391530    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 16:39:15.392018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.391833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 16:39:15.392228 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.392175    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:15.392277 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.392233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:15.392327 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.392272    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pzj7k\""
Jul 07 16:39:15.392522 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.392503    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 16:39:15.392848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.392804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kxz68\""
Jul 07 16:39:15.395190 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.395172    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbpbr"
Jul 07 16:39:15.419717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.419701    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-host\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-ovn\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-cnibin\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cnibin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-multus\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c072679b-a7a8-42f0-97df-289ec7399e48-serviceca\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kv9h\" (UniqueName: \"kubernetes.io/projected/4292bfec-88b4-4129-b64d-b158026e3d2e-kube-api-access-4kv9h\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-slash\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.428991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-netns\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovn-node-metrics-cert\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwxf8\" (UniqueName: \"kubernetes.io/projected/5cd4476d-792e-4022-b08e-28f5e8ed3c70-kube-api-access-fwxf8\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfhx8\" (UniqueName: \"kubernetes.io/projected/7a8df170-a942-4075-89a1-e83d331f3340-kube-api-access-dfhx8\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-sys-fs\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mm7d\" (UniqueName: \"kubernetes.io/projected/deb5fca9-079a-4da2-9ee3-3230e475257a-kube-api-access-7mm7d\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-script-lib\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-conf\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-node-log\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-log-socket\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-sys\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-system-cni-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c072679b-a7a8-42f0-97df-289ec7399e48-host\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.429992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-kubelet-config\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d4912db-01db-4831-8a1f-989333dca9c9-konnectivity-ca\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4292bfec-88b4-4129-b64d-b158026e3d2e-tmp-dir\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-socket-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-systemd-units\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-systemd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-os-release\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-socket-dir-parent\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-hostroot\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-daemon-config\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnbm9\" (UniqueName: \"kubernetes.io/projected/d48470a9-13cf-44b9-980a-ab629ab33319-kube-api-access-xnbm9\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-bin\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-etc-kubernetes\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.430570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-lib-modules\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ac774c-5351-4506-8a2c-b286f114646f-iptables-alerter-script\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-etc-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-netd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-config\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.429985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-os-release\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-bin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-conf-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-kubernetes\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cni-binary-copy\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-modprobe-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-etc-tuned\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grct\" (UniqueName: \"kubernetes.io/projected/c072679b-a7a8-42f0-97df-289ec7399e48-kube-api-access-4grct\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:15.431249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9ln\" (UniqueName: \"kubernetes.io/projected/54ac774c-5351-4506-8a2c-b286f114646f-kube-api-access-ss9ln\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-device-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-netns\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-registration-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-kubelet\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-var-lib-kubelet\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4292bfec-88b4-4129-b64d-b158026e3d2e-hosts-file\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ac774c-5351-4506-8a2c-b286f114646f-host-slash\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-kubelet\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-k8s-cni-cncf-io\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.431992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-tmp\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-dbus\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66kd\" (UniqueName: \"kubernetes.io/projected/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kube-api-access-s66kd\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-system-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdqw\" (UniqueName: \"kubernetes.io/projected/f60e40fc-f0c8-4262-9036-2ddb4183dce4-kube-api-access-rmdqw\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysconfig\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d4912db-01db-4831-8a1f-989333dca9c9-agent-certs\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.430998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-var-lib-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.431022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-env-overrides\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.431044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-multus-certs\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.431065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-systemd\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.432657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.431087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-run\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.443886 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.443700    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:15.497280 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.497225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"299a87a4a45d9b26418fa6fd3ad1b8de","Type":"ContainerStarted","Data":"8237a44239880ea997e8aa359c0ab0407438c978232ecbdc75b24fb7b769090c"}
Jul 07 16:39:15.498675 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.498647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" event={"ID":"fb5189a869022cef34eed256cb1ca3a3","Type":"ContainerStarted","Data":"5d94c9a202162392d471b7c1b42b53eed83668491e03c80b7fb1f773b4e0516d"}
Jul 07 16:39:15.531377 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66kd\" (UniqueName: \"kubernetes.io/projected/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kube-api-access-s66kd\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.531377 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.531377 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-system-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdqw\" (UniqueName: \"kubernetes.io/projected/f60e40fc-f0c8-4262-9036-2ddb4183dce4-kube-api-access-rmdqw\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysconfig\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d4912db-01db-4831-8a1f-989333dca9c9-agent-certs\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-var-lib-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-env-overrides\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-multus-certs\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-systemd\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.531598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-run\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-host\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-ovn\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-cnibin\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-cnibin\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531757    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysconfig\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-system-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cnibin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531792    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-host\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531878    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-var-lib-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cnibin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-multus\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c072679b-a7a8-42f0-97df-289ec7399e48-serviceca\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531957    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-multus-certs\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531983    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-ovn\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.531995    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-systemd\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.532031    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532145    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-run\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532194    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-multus\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532189    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kv9h\" (UniqueName: \"kubernetes.io/projected/4292bfec-88b4-4129-b64d-b158026e3d2e-kube-api-access-4kv9h\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.532240    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-slash\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532307    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-slash\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.532316    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:16.032276172 +0000 UTC m=+3.037842362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-netns\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovn-node-metrics-cert\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.532640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwxf8\" (UniqueName: \"kubernetes.io/projected/5cd4476d-792e-4022-b08e-28f5e8ed3c70-kube-api-access-fwxf8\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfhx8\" (UniqueName: \"kubernetes.io/projected/7a8df170-a942-4075-89a1-e83d331f3340-kube-api-access-dfhx8\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c072679b-a7a8-42f0-97df-289ec7399e48-serviceca\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532486    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-env-overrides\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.532519    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:16.032498716 +0000 UTC m=+3.038064912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-sys-fs\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532544    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-sys-fs\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mm7d\" (UniqueName: \"kubernetes.io/projected/deb5fca9-079a-4da2-9ee3-3230e475257a-kube-api-access-7mm7d\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532577    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-netns\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-script-lib\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-conf\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.533243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-node-log\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-log-socket\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-sys\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-system-cni-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c072679b-a7a8-42f0-97df-289ec7399e48-host\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-kubelet-config\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d4912db-01db-4831-8a1f-989333dca9c9-konnectivity-ca\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4292bfec-88b4-4129-b64d-b158026e3d2e-tmp-dir\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-socket-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-systemd-units\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-systemd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532973    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c072679b-a7a8-42f0-97df-289ec7399e48-host\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.533799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.532986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-os-release\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-socket-dir-parent\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-hostroot\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-daemon-config\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533071    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnbm9\" (UniqueName: \"kubernetes.io/projected/d48470a9-13cf-44b9-980a-ab629ab33319-kube-api-access-xnbm9\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533134    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-kubelet-config\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-bin\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-bin\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533234    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-node-log\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-etc-kubernetes\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-etc-kubernetes\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-lib-modules\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.534341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-conf\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533292    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-socket-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ac774c-5351-4506-8a2c-b286f114646f-iptables-alerter-script\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-system-cni-dir\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-etc-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533333    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-systemd-units\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-netd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533371    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-run-systemd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-sys\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-config\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-os-release\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533435    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a8df170-a942-4075-89a1-e83d331f3340-os-release\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-bin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-conf-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533486    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-socket-dir-parent\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.534999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-kubernetes\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-script-lib\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533527    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-hostroot\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cni-binary-copy\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-modprobe-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-etc-tuned\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grct\" (UniqueName: \"kubernetes.io/projected/c072679b-a7a8-42f0-97df-289ec7399e48-kube-api-access-4grct\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9ln\" (UniqueName: \"kubernetes.io/projected/54ac774c-5351-4506-8a2c-b286f114646f-kube-api-access-ss9ln\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-device-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-netns\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-registration-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533827    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovnkube-config\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.535737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-kubelet\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533886    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-log-socket\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-var-lib-kubelet\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4292bfec-88b4-4129-b64d-b158026e3d2e-hosts-file\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ac774c-5351-4506-8a2c-b286f114646f-host-slash\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.533990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-kubelet\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534050    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-cni-binary-copy\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534091    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-daemon-config\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-k8s-cni-cncf-io\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-tmp\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-dbus\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.536386 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4214a03-83cb-49df-889b-0e098d963c07-dbus\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534376    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-etc-selinux\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534384    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d4912db-01db-4831-8a1f-989333dca9c9-konnectivity-ca\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534419    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-os-release\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534441    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-etc-openvswitch\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534462    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-cni-bin\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-cni-netd\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534500    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-conf-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534542    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-kubernetes\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-multus-cni-dir\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534579    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-k8s-cni-cncf-io\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534859    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-modprobe-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.534947    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54ac774c-5351-4506-8a2c-b286f114646f-iptables-alerter-script\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535038    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a8df170-a942-4075-89a1-e83d331f3340-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.537105 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-registration-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535211    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4292bfec-88b4-4129-b64d-b158026e3d2e-tmp-dir\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535347    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-lib-modules\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535406    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-device-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-run-netns\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535644    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60e40fc-f0c8-4262-9036-2ddb4183dce4-host-var-lib-kubelet\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535700    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-var-lib-kubelet\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d48470a9-13cf-44b9-980a-ab629ab33319-etc-sysctl-d\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd4476d-792e-4022-b08e-28f5e8ed3c70-host-kubelet\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535787    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4292bfec-88b4-4129-b64d-b158026e3d2e-hosts-file\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.537803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.535743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54ac774c-5351-4506-8a2c-b286f114646f-host-slash\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.539323 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.539300    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd4476d-792e-4022-b08e-28f5e8ed3c70-ovn-node-metrics-cert\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.540234 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.540017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d4912db-01db-4831-8a1f-989333dca9c9-agent-certs\") pod \"konnectivity-agent-2mj5d\" (UID: \"3d4912db-01db-4831-8a1f-989333dca9c9\") " pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.540234 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.540140    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-tmp\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.540234 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.539665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d48470a9-13cf-44b9-980a-ab629ab33319-etc-tuned\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.541967 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.541946    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:15.541967 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.541971    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:15.542124 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.541984    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:15.542124 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:15.542039    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:16.042023288 +0000 UTC m=+3.047589479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:15.542124 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.542080    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kv9h\" (UniqueName: \"kubernetes.io/projected/4292bfec-88b4-4129-b64d-b158026e3d2e-kube-api-access-4kv9h\") pod \"node-resolver-5f6ts\" (UID: \"4292bfec-88b4-4129-b64d-b158026e3d2e\") " pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.545046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.544603    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwxf8\" (UniqueName: \"kubernetes.io/projected/5cd4476d-792e-4022-b08e-28f5e8ed3c70-kube-api-access-fwxf8\") pod \"ovnkube-node-vhccm\" (UID: \"5cd4476d-792e-4022-b08e-28f5e8ed3c70\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.545046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.544973    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mm7d\" (UniqueName: \"kubernetes.io/projected/deb5fca9-079a-4da2-9ee3-3230e475257a-kube-api-access-7mm7d\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:15.545046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.545012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfhx8\" (UniqueName: \"kubernetes.io/projected/7a8df170-a942-4075-89a1-e83d331f3340-kube-api-access-dfhx8\") pod \"multus-additional-cni-plugins-ppglm\" (UID: \"7a8df170-a942-4075-89a1-e83d331f3340\") " pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.546362 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.546341    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grct\" (UniqueName: \"kubernetes.io/projected/c072679b-a7a8-42f0-97df-289ec7399e48-kube-api-access-4grct\") pod \"node-ca-6nzd8\" (UID: \"c072679b-a7a8-42f0-97df-289ec7399e48\") " pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.546804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.546780    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66kd\" (UniqueName: \"kubernetes.io/projected/0f6bf7eb-6054-47be-85a6-e0b7fea4e798-kube-api-access-s66kd\") pod \"aws-ebs-csi-driver-node-x2lm2\" (UID: \"0f6bf7eb-6054-47be-85a6-e0b7fea4e798\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.547473 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.547454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9ln\" (UniqueName: \"kubernetes.io/projected/54ac774c-5351-4506-8a2c-b286f114646f-kube-api-access-ss9ln\") pod \"iptables-alerter-64mmh\" (UID: \"54ac774c-5351-4506-8a2c-b286f114646f\") " pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.548031 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.548009    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnbm9\" (UniqueName: \"kubernetes.io/projected/d48470a9-13cf-44b9-980a-ab629ab33319-kube-api-access-xnbm9\") pod \"tuned-q7q2j\" (UID: \"d48470a9-13cf-44b9-980a-ab629ab33319\") " pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.549312 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.549295    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdqw\" (UniqueName: \"kubernetes.io/projected/f60e40fc-f0c8-4262-9036-2ddb4183dce4-kube-api-access-rmdqw\") pod \"multus-vppt7\" (UID: \"f60e40fc-f0c8-4262-9036-2ddb4183dce4\") " pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.671888 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.671853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7q2j"
Jul 07 16:39:15.681778 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.681752    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6nzd8"
Jul 07 16:39:15.682037 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.682006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48470a9_13cf_44b9_980a_ab629ab33319.slice/crio-176c489245c8ca3461bc6fbe9cdc32799afb3e6f936a394333cacd68e44c43b0 WatchSource:0}: Error finding container 176c489245c8ca3461bc6fbe9cdc32799afb3e6f936a394333cacd68e44c43b0: Status 404 returned error can't find the container with id 176c489245c8ca3461bc6fbe9cdc32799afb3e6f936a394333cacd68e44c43b0
Jul 07 16:39:15.690971 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.690947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc072679b_a7a8_42f0_97df_289ec7399e48.slice/crio-c72ddafb4191e5b0409704bc0cc994bba52cc0ede3fa9843c0f7fb9edf45fdf2 WatchSource:0}: Error finding container c72ddafb4191e5b0409704bc0cc994bba52cc0ede3fa9843c0f7fb9edf45fdf2: Status 404 returned error can't find the container with id c72ddafb4191e5b0409704bc0cc994bba52cc0ede3fa9843c0f7fb9edf45fdf2
Jul 07 16:39:15.698899 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.698873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:15.705852 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.705831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2"
Jul 07 16:39:15.707879 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.707854    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4912db_01db_4831_8a1f_989333dca9c9.slice/crio-eb3f584838dc455e118d6c2ebc038b77608cb46a675113b0386e995d7959adc1 WatchSource:0}: Error finding container eb3f584838dc455e118d6c2ebc038b77608cb46a675113b0386e995d7959adc1: Status 404 returned error can't find the container with id eb3f584838dc455e118d6c2ebc038b77608cb46a675113b0386e995d7959adc1
Jul 07 16:39:15.714350 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.714322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5f6ts"
Jul 07 16:39:15.714800 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.714777    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6bf7eb_6054_47be_85a6_e0b7fea4e798.slice/crio-ca6f5fcc76e523396a5ad35cc314e4b6d174d4617da0309fb291aeeed2250e79 WatchSource:0}: Error finding container ca6f5fcc76e523396a5ad35cc314e4b6d174d4617da0309fb291aeeed2250e79: Status 404 returned error can't find the container with id ca6f5fcc76e523396a5ad35cc314e4b6d174d4617da0309fb291aeeed2250e79
Jul 07 16:39:15.722346 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.722325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:15.723303 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.723281    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4292bfec_88b4_4129_b64d_b158026e3d2e.slice/crio-5573367232c1e6b3ab7581c6de85d9c2152621a36aaf6265366982b0d07be53f WatchSource:0}: Error finding container 5573367232c1e6b3ab7581c6de85d9c2152621a36aaf6265366982b0d07be53f: Status 404 returned error can't find the container with id 5573367232c1e6b3ab7581c6de85d9c2152621a36aaf6265366982b0d07be53f
Jul 07 16:39:15.731304 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.731281    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd4476d_792e_4022_b08e_28f5e8ed3c70.slice/crio-58c6bebd88739df4e878f48e49e63156e04bb0550bdfa0ead628f2640f7cf1c7 WatchSource:0}: Error finding container 58c6bebd88739df4e878f48e49e63156e04bb0550bdfa0ead628f2640f7cf1c7: Status 404 returned error can't find the container with id 58c6bebd88739df4e878f48e49e63156e04bb0550bdfa0ead628f2640f7cf1c7
Jul 07 16:39:15.738898 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.738869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppglm"
Jul 07 16:39:15.748452 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.748417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64mmh"
Jul 07 16:39:15.748452 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.748424    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8df170_a942_4075_89a1_e83d331f3340.slice/crio-a7e982e535373c9d949c269fb12611bcf05d1aa8aa2e3c4598ab11a4d3263941 WatchSource:0}: Error finding container a7e982e535373c9d949c269fb12611bcf05d1aa8aa2e3c4598ab11a4d3263941: Status 404 returned error can't find the container with id a7e982e535373c9d949c269fb12611bcf05d1aa8aa2e3c4598ab11a4d3263941
Jul 07 16:39:15.754391 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:15.754368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vppt7"
Jul 07 16:39:15.758789 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.758765    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ac774c_5351_4506_8a2c_b286f114646f.slice/crio-3eca5c7217b5cbe0fd50f941f60279e1154065cdaf962ae6f6a2bc751c4e934a WatchSource:0}: Error finding container 3eca5c7217b5cbe0fd50f941f60279e1154065cdaf962ae6f6a2bc751c4e934a: Status 404 returned error can't find the container with id 3eca5c7217b5cbe0fd50f941f60279e1154065cdaf962ae6f6a2bc751c4e934a
Jul 07 16:39:15.767113 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:15.767089    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60e40fc_f0c8_4262_9036_2ddb4183dce4.slice/crio-3ec1deded80d35dab321d48526f42d9480ffd765b99f8193a98bd9c510346d92 WatchSource:0}: Error finding container 3ec1deded80d35dab321d48526f42d9480ffd765b99f8193a98bd9c510346d92: Status 404 returned error can't find the container with id 3ec1deded80d35dab321d48526f42d9480ffd765b99f8193a98bd9c510346d92
Jul 07 16:39:16.037914 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.037881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:16.038110 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.037924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:16.038110 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.038048    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:16.038110 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.038059    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:16.038110 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.038100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:17.038086874 +0000 UTC m=+4.043653061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:16.038281 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.038125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:17.038105979 +0000 UTC m=+4.043672170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:16.129290 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.129261    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:39:16.138784 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.138761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:16.138939 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.138923    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:16.138996 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.138949    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:16.138996 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.138962    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:16.139108 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.139022    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:17.139002354 +0000 UTC m=+4.144568554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:16.399324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.399285    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:34:15 +0000 UTC" deadline="2028-02-07 16:23:43.38156679 +0000 UTC"
Jul 07 16:39:16.399324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.399319    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13919h44m26.982252294s"
Jul 07 16:39:16.491967 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.491933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:16.492103 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:16.492051    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:16.501422 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.501379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vppt7" event={"ID":"f60e40fc-f0c8-4262-9036-2ddb4183dce4","Type":"ContainerStarted","Data":"3ec1deded80d35dab321d48526f42d9480ffd765b99f8193a98bd9c510346d92"}
Jul 07 16:39:16.502601 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.502567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerStarted","Data":"a7e982e535373c9d949c269fb12611bcf05d1aa8aa2e3c4598ab11a4d3263941"}
Jul 07 16:39:16.503671 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.503643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5f6ts" event={"ID":"4292bfec-88b4-4129-b64d-b158026e3d2e","Type":"ContainerStarted","Data":"5573367232c1e6b3ab7581c6de85d9c2152621a36aaf6265366982b0d07be53f"}
Jul 07 16:39:16.504857 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.504835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" event={"ID":"0f6bf7eb-6054-47be-85a6-e0b7fea4e798","Type":"ContainerStarted","Data":"ca6f5fcc76e523396a5ad35cc314e4b6d174d4617da0309fb291aeeed2250e79"}
Jul 07 16:39:16.505982 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.505960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7q2j" event={"ID":"d48470a9-13cf-44b9-980a-ab629ab33319","Type":"ContainerStarted","Data":"176c489245c8ca3461bc6fbe9cdc32799afb3e6f936a394333cacd68e44c43b0"}
Jul 07 16:39:16.507146 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.507114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64mmh" event={"ID":"54ac774c-5351-4506-8a2c-b286f114646f","Type":"ContainerStarted","Data":"3eca5c7217b5cbe0fd50f941f60279e1154065cdaf962ae6f6a2bc751c4e934a"}
Jul 07 16:39:16.508315 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.508282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"58c6bebd88739df4e878f48e49e63156e04bb0550bdfa0ead628f2640f7cf1c7"}
Jul 07 16:39:16.509478 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.509457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mj5d" event={"ID":"3d4912db-01db-4831-8a1f-989333dca9c9","Type":"ContainerStarted","Data":"eb3f584838dc455e118d6c2ebc038b77608cb46a675113b0386e995d7959adc1"}
Jul 07 16:39:16.510502 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:16.510483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6nzd8" event={"ID":"c072679b-a7a8-42f0-97df-289ec7399e48","Type":"ContainerStarted","Data":"c72ddafb4191e5b0409704bc0cc994bba52cc0ede3fa9843c0f7fb9edf45fdf2"}
Jul 07 16:39:17.046834 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.046585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:17.047421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.046862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:17.047421 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.047046    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:17.047421 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.047107    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:19.047088456 +0000 UTC m=+6.052654647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:17.047601 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.047501    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:17.047601 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.047547    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:19.047530245 +0000 UTC m=+6.053096436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:17.148249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.147343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:17.148249 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.147572    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:17.148249 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.147647    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:17.148249 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.147698    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:17.148249 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.147758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:19.147739974 +0000 UTC m=+6.153306163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:17.399993 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.399926    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:34:15 +0000 UTC" deadline="2027-12-04 23:10:42.486660032 +0000 UTC"
Jul 07 16:39:17.399993 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.399990    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12366h31m25.086673665s"
Jul 07 16:39:17.493787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.492944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:17.493787 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.493066    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:17.493787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.493446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:17.493787 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:17.493544    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:17.526961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:17.526923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" event={"ID":"fb5189a869022cef34eed256cb1ca3a3","Type":"ContainerStarted","Data":"4605a798b9c3c2cf47b18f538e5cc000a14a8729eb679ca13a8624bfc2446f53"}
Jul 07 16:39:18.491427 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:18.491387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:18.491958 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:18.491535    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:18.550015 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:18.549472    2565 generic.go:356] "Generic (PLEG): container finished" podID="299a87a4a45d9b26418fa6fd3ad1b8de" containerID="27c410f507c3b301b9301aac9f3eee1ddff91cde3067180a252753d3966d0007" exitCode=0
Jul 07 16:39:18.550015 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:18.549571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"299a87a4a45d9b26418fa6fd3ad1b8de","Type":"ContainerDied","Data":"27c410f507c3b301b9301aac9f3eee1ddff91cde3067180a252753d3966d0007"}
Jul 07 16:39:18.574295 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:18.574237    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" podStartSLOduration=4.574217454 podStartE2EDuration="4.574217454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:17.560826323 +0000 UTC m=+4.566392524" watchObservedRunningTime="2026-07-07 16:39:18.574217454 +0000 UTC m=+5.579783663"
Jul 07 16:39:19.063065 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.062975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:19.063065 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.063026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:19.063287 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.063201    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:19.063287 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.063261    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:23.063243392 +0000 UTC m=+10.068809593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:19.063659 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.063642    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:19.063745 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.063692    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:23.063678034 +0000 UTC m=+10.069244239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:19.163861 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.163806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:19.164043 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.164024    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:19.164043 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.164043    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:19.164150 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.164056    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:19.164150 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.164114    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:23.164096925 +0000 UTC m=+10.169663134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:19.492753 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.492631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:19.492753 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.492655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:19.493402 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.492758    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:19.493402 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:19.493179    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:19.554424 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:19.554385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"299a87a4a45d9b26418fa6fd3ad1b8de","Type":"ContainerStarted","Data":"66528120293fecc80e933b5ad243d37242f24714a5530b07c36ff904fe69121a"}
Jul 07 16:39:20.491737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:20.491654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:20.491934 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:20.491788    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:21.491647 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:21.491609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:21.492187 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:21.491733    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:21.492187 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:21.491609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:21.492187 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:21.491953    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:22.492091 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:22.492054    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:22.492549 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:22.492200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:23.095040 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:23.094991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:23.095229 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.095145    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:23.095229 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:23.095158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:23.095326 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.095239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:31.095219915 +0000 UTC m=+18.100786101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:23.095326 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.095287    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:23.095408 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.095338    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:31.095322211 +0000 UTC m=+18.100888397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:23.196182 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:23.196142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:23.196365 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.196331    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:23.196365 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.196356    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:23.196365 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.196368    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:23.196532 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.196436    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:31.196416819 +0000 UTC m=+18.201983030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:23.492360 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:23.492317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:23.492793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.492419    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:23.492793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:23.492476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:23.492793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:23.492562    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:24.491416 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:24.491373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:24.491587 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:24.491512    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:25.491524 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:25.491490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:25.492014 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:25.491607    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:25.492014 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:25.491676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:25.492014 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:25.491800    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:26.491459 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:26.491354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:26.491531 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:26.491454    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:27.491947 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.491905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:27.492372 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:27.492049    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:27.492372 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.492128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:27.492372 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:27.492237    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:27.572529 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.572460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5f6ts" event={"ID":"4292bfec-88b4-4129-b64d-b158026e3d2e","Type":"ContainerStarted","Data":"6895158127cf709e1361332ed9b6999a3bef1d54afff00e4d63e84abd042c63d"}
Jul 07 16:39:27.574737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.574705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" event={"ID":"0f6bf7eb-6054-47be-85a6-e0b7fea4e798","Type":"ContainerStarted","Data":"5d676d5616654bbb6afe04bba8a750710473ccb38c20c276912094d97f189e06"}
Jul 07 16:39:27.576370 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.576339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7q2j" event={"ID":"d48470a9-13cf-44b9-980a-ab629ab33319","Type":"ContainerStarted","Data":"5ff62efeada911e9eca5af88fced07a3cc162186bc853c9b841023a0a2159a1b"}
Jul 07 16:39:27.578447 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.578427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mj5d" event={"ID":"3d4912db-01db-4831-8a1f-989333dca9c9","Type":"ContainerStarted","Data":"744b67d216da60f3e47558198ffc4a0590674b455afd374217d01c513903e685"}
Jul 07 16:39:27.580037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.580014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6nzd8" event={"ID":"c072679b-a7a8-42f0-97df-289ec7399e48","Type":"ContainerStarted","Data":"10e355e8cc65496baf95bab957a6d12a19851c4cc2bd108dddb2082d9abaa3e6"}
Jul 07 16:39:27.581973 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.581948    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="7ce6a6280e845588cd07b6952c994c60915c8fce7aad8b83c06d64075a38f568" exitCode=0
Jul 07 16:39:27.582062 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.581983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"7ce6a6280e845588cd07b6952c994c60915c8fce7aad8b83c06d64075a38f568"}
Jul 07 16:39:27.592053 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.592006    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5f6ts" podStartSLOduration=3.812250221 podStartE2EDuration="14.591989333s" totalImagesPullingTime="10.779739112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:27.591695913 +0000 UTC m=+14.597262122" watchObservedRunningTime="2026-07-07 16:39:27.591989333 +0000 UTC m=+14.597555556"
Jul 07 16:39:27.592167 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.592091    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" podStartSLOduration=13.592084394 podStartE2EDuration="13.592084394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:19.574405966 +0000 UTC m=+6.579972174" watchObservedRunningTime="2026-07-07 16:39:27.592084394 +0000 UTC m=+14.597650601"
Jul 07 16:39:27.650537 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.650480    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q7q2j" podStartSLOduration=3.826703495 podStartE2EDuration="14.650460943s" totalImagesPullingTime="10.823757448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:27.649634457 +0000 UTC m=+14.655200665" watchObservedRunningTime="2026-07-07 16:39:27.650460943 +0000 UTC m=+14.656027151"
Jul 07 16:39:27.670203 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.670161    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mj5d" podStartSLOduration=3.874947773 podStartE2EDuration="14.670149359s" totalImagesPullingTime="10.795201586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:27.669902379 +0000 UTC m=+14.675468606" watchObservedRunningTime="2026-07-07 16:39:27.670149359 +0000 UTC m=+14.675715566"
Jul 07 16:39:27.695890 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:27.695839    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6nzd8" podStartSLOduration=3.90252538 podStartE2EDuration="14.69580716s" totalImagesPullingTime="10.79328178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:27.695433675 +0000 UTC m=+14.700999907" watchObservedRunningTime="2026-07-07 16:39:27.69580716 +0000 UTC m=+14.701373372"
Jul 07 16:39:28.491582 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:28.491541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:28.491730 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:28.491654    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:28.585917 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:28.585871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64mmh" event={"ID":"54ac774c-5351-4506-8a2c-b286f114646f","Type":"ContainerStarted","Data":"cec3d1a20b4960d307620e7e01b27491527e5705f5e527c5e3341fe1da256989"}
Jul 07 16:39:28.605167 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:28.605115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-64mmh" podStartSLOduration=4.860559422 podStartE2EDuration="15.605098761s" totalImagesPullingTime="10.744539339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:28.604494387 +0000 UTC m=+15.610060595" watchObservedRunningTime="2026-07-07 16:39:28.605098761 +0000 UTC m=+15.610664970"
Jul 07 16:39:29.491770 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:29.491722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:29.491770 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:29.491752    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:29.492006 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:29.491863    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:29.492077 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:29.492026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:29.769018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:29.768933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:29.769641 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:29.769620    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:30.492046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:30.492016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:30.492236 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:30.492136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:30.592713 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:30.590760    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:30.593343 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:30.593319    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mj5d"
Jul 07 16:39:31.154012 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:31.153977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:31.154624 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:31.154024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:31.154624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.154146    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:31.154624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.154151    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:31.154624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.154212    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:47.154194347 +0000 UTC m=+34.159760756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:31.154624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.154232    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:47.154222428 +0000 UTC m=+34.159788615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:31.254634 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:31.254597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:31.254841 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.254802    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:31.254913 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.254852    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:31.254913 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.254869    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:31.255050 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.254933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:47.254914035 +0000 UTC m=+34.260480238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:31.492397 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:31.492323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:31.492536 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:31.492323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:31.492536 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.492464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:31.492632 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:31.492529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:32.491676 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:32.491644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:32.492285 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:32.491755    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:33.492857 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:33.492827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:33.493265 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:33.492936    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:33.493265 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:33.493002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:33.493265 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:33.493132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:34.491968 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:34.491934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:34.492134 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:34.492050    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:35.492201 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:35.492164    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:35.492624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:35.492269    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:35.492624 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:35.492388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:35.492624 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:35.492519    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:35.730108 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:35.730067    2565 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:68529331cdc4ac4a5726b1e57724410571d94df89e33335f102b16f4f674c212: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa590e7fc5391b1007aa63e4e4488de68ce3695cc319d50a3f9b438deda90b29"
Jul 07 16:39:35.730263 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:35.730173    2565 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-x2lm2_openshift-cluster-csi-drivers(0f6bf7eb-6054-47be-85a6-e0b7fea4e798): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:68529331cdc4ac4a5726b1e57724410571d94df89e33335f102b16f4f674c212: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 07 16:39:36.492487 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.492230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:36.493103 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:36.492582    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:36.606241 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"cf7b50fa151a0820bf26eb2d057dd775368708d23420125bb4e5ce2325cc37e2"}
Jul 07 16:39:36.606454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"33128c63f99abfdd0454318f58be6afc0dd17a5387cca41a5bccac701041fd13"}
Jul 07 16:39:36.606454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"24b51d98acfa03a8cbe42998510032b040ccbaf93cf61da736c07fcc515060d0"}
Jul 07 16:39:36.606454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"b80be79f9361a7c78d65b3a5cb56c0789ce425de9531cfad668a9180771ff25d"}
Jul 07 16:39:36.606454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"8e4a499dd34797ea5a4c4300f6839f86187e4733c9051d45aa77af0830c4a800"}
Jul 07 16:39:36.606454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.606433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"5c2cf7fb6d6aafce5d003206768aa9eeb60c10829b46d3e58576d86a1303b67a"}
Jul 07 16:39:36.607770 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.607747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vppt7" event={"ID":"f60e40fc-f0c8-4262-9036-2ddb4183dce4","Type":"ContainerStarted","Data":"f91d5f0d0e96755e51ae8ef3442a43cc3ea4999fdc8df9f2fe58a99d686730a6"}
Jul 07 16:39:36.629823 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:36.629775    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vppt7" podStartSLOduration=3.7815352669999998 podStartE2EDuration="23.629758434s" totalImagesPullingTime="19.848223167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:36.629096295 +0000 UTC m=+23.634662507" watchObservedRunningTime="2026-07-07 16:39:36.629758434 +0000 UTC m=+23.635324647"
Jul 07 16:39:37.492199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:37.492160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:37.492469 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:37.492177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:37.492469 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:37.492283    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:37.492469 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:37.492360    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:38.491974 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:38.491896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:38.492123 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:38.492004    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:38.810317 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:38.810281    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:68529331cdc4ac4a5726b1e57724410571d94df89e33335f102b16f4f674c212: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" podUID="0f6bf7eb-6054-47be-85a6-e0b7fea4e798"
Jul 07 16:39:39.492296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.492258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:39.492296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.492291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:39.492637 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:39.492387    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:39.492637 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:39.492465    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:39.615539 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.615505    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="eb7aeb0b2cf83e0df32e93b3662acd86be4d7295d98d7ae1d9f116e4db515689" exitCode=0
Jul 07 16:39:39.615761 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.615584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"eb7aeb0b2cf83e0df32e93b3662acd86be4d7295d98d7ae1d9f116e4db515689"}
Jul 07 16:39:39.617363 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.617337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" event={"ID":"0f6bf7eb-6054-47be-85a6-e0b7fea4e798","Type":"ContainerStarted","Data":"c88ed44d704ae25b52a63e613aa08940b520b1984a6ed1df22939eee952e6e2c"}
Jul 07 16:39:39.618480 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:39.618454    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa590e7fc5391b1007aa63e4e4488de68ce3695cc319d50a3f9b438deda90b29\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:68529331cdc4ac4a5726b1e57724410571d94df89e33335f102b16f4f674c212: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" podUID="0f6bf7eb-6054-47be-85a6-e0b7fea4e798"
Jul 07 16:39:39.620613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:39.620592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"4fb7788ac560f097dff429912b65d55c9b16f045c2bbc470a01536a8440dede7"}
Jul 07 16:39:40.491843 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:40.491795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:40.492400 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:40.491932    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:40.623914 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:40.623887    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:aa590e7fc5391b1007aa63e4e4488de68ce3695cc319d50a3f9b438deda90b29\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:68529331cdc4ac4a5726b1e57724410571d94df89e33335f102b16f4f674c212: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" podUID="0f6bf7eb-6054-47be-85a6-e0b7fea4e798"
Jul 07 16:39:41.491941 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.491692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:41.492407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.491700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:41.492407 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:41.491977    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:41.492407 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:41.492059    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:41.628324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.628290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" event={"ID":"5cd4476d-792e-4022-b08e-28f5e8ed3c70","Type":"ContainerStarted","Data":"10996c0a7ad82e28c796260c9cadd92d62f78a8686bbd914d813f81d7be6b831"}
Jul 07 16:39:41.628545 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.628521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:41.630486 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.630465    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="0b26eac76968dfdd92910a16bb768363e368c02f12ce1b252c442080bd582e9f" exitCode=0
Jul 07 16:39:41.630584 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.630492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"0b26eac76968dfdd92910a16bb768363e368c02f12ce1b252c442080bd582e9f"}
Jul 07 16:39:41.645042 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.645024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:41.657137 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:41.657097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm" podStartSLOduration=8.765423002 podStartE2EDuration="28.657084276s" totalImagesPullingTime="19.891661274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:41.656617022 +0000 UTC m=+28.662183260" watchObservedRunningTime="2026-07-07 16:39:41.657084276 +0000 UTC m=+28.662650484"
Jul 07 16:39:42.491962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.491929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:42.492314 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:42.492031    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:42.633773 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.633613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:42.633773 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.633708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:42.649739 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.649714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:39:42.891864 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.891838    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22ddz"]
Jul 07 16:39:42.892031 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.891946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:42.892082 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:42.892028    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:42.894491 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.894471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mn7vv"]
Jul 07 16:39:42.894582 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.894538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:42.894622 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:42.894603    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:42.897446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.897427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrp9n"]
Jul 07 16:39:42.897538 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:42.897529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:42.897643 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:42.897625    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:43.637558 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:43.637523    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="c51ed78518088b38daf1c695ad0e597413086e9cca735a6f5f892673bb4df521" exitCode=0
Jul 07 16:39:43.637998 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:43.637603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"c51ed78518088b38daf1c695ad0e597413086e9cca735a6f5f892673bb4df521"}
Jul 07 16:39:44.492004 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:44.491975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:44.492167 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:44.491975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:44.492167 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:44.492086    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:44.492167 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:44.491975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:44.492335 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:44.492164    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:44.492335 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:44.492234    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:46.491624 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:46.491446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:46.491989 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:46.491446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:46.491989 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:46.491695    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22ddz" podUID="db59a98a-0b1f-46c8-877a-035df742efc2"
Jul 07 16:39:46.491989 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:46.491446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:46.491989 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:46.491765    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mn7vv" podUID="f4214a03-83cb-49df-889b-0e098d963c07"
Jul 07 16:39:46.491989 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:46.491862    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrp9n" podUID="deb5fca9-079a-4da2-9ee3-3230e475257a"
Jul 07 16:39:47.181061 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:47.181029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:47.181256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:47.181074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:47.181256 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.181190    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:47.181256 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.181205    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:47.181384 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.181256    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret podName:f4214a03-83cb-49df-889b-0e098d963c07 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:19.181235613 +0000 UTC m=+66.186801801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret") pod "global-pull-secret-syncer-mn7vv" (UID: "f4214a03-83cb-49df-889b-0e098d963c07") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:39:47.181384 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.181277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs podName:deb5fca9-079a-4da2-9ee3-3230e475257a nodeName:}" failed. No retries permitted until 2026-07-07 16:40:19.181267179 +0000 UTC m=+66.186833369 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs") pod "network-metrics-daemon-wrp9n" (UID: "deb5fca9-079a-4da2-9ee3-3230e475257a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:39:47.282095 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:47.282040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:47.282276 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.282208    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:39:47.282276 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.282230    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:39:47.282276 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.282241    2565 projected.go:196] Error preparing data for projected volume kube-api-access-hgmdv for pod openshift-network-diagnostics/network-check-target-22ddz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:47.282464 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:47.282295    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv podName:db59a98a-0b1f-46c8-877a-035df742efc2 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:19.282277589 +0000 UTC m=+66.287843775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgmdv" (UniqueName: "kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv") pod "network-check-target-22ddz" (UID: "db59a98a-0b1f-46c8-877a-035df742efc2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:39:48.344628 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.344541    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeReady"
Jul 07 16:39:48.345067 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.344686    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 16:39:48.399564 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.399530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:39:48.405361 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.405334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.409555 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.409529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 16:39:48.410253 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.409643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 16:39:48.410253 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.409792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-45v4k\""
Jul 07 16:39:48.410253 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.410046    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 16:39:48.415946 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.415540    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jwq82"]
Jul 07 16:39:48.418255 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.418228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 16:39:48.419306 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.419286    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6bpgv"]
Jul 07 16:39:48.419444 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.419411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.423079 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.423059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.423947 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.423928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:39:48.424992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.424974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 16:39:48.425092 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.425046    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z577\""
Jul 07 16:39:48.425092 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.425075    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 16:39:48.426432 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.426413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 16:39:48.426534 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.426464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 16:39:48.426534 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.426490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jntjt\""
Jul 07 16:39:48.426979 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.426960    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 16:39:48.436140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.435955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bpgv"]
Jul 07 16:39:48.436635 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.436619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwq82"]
Jul 07 16:39:48.491422 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:39:48.491607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:39:48.491607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:39:48.491607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f7011b-561c-438e-83f6-d9a9c076a92a-tmp-dir\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hc2\" (UniqueName: \"kubernetes.io/projected/e9f7011b-561c-438e-83f6-d9a9c076a92a-kube-api-access-c4hc2\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dhf\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.491873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f7011b-561c-438e-83f6-d9a9c076a92a-config-volume\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.492254 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.491882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.494276 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494253    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:39:48.494398 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:39:48.494544 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494527    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctnwh\""
Jul 07 16:39:48.494618 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:39:48.494618 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5w7gr\""
Jul 07 16:39:48.494716 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.494671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:39:48.593129 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593129 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593347 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593347 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:48.593262    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:39:48.593347 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:48.593278    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:39:48.593347 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f7011b-561c-438e-83f6-d9a9c076a92a-tmp-dir\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.593347 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:48.593339    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.093319989 +0000 UTC m=+36.098886179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:39:48.593590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plz59\" (UniqueName: \"kubernetes.io/projected/c39885ba-6190-41d6-bf7c-02f0cc147a8e-kube-api-access-plz59\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.593590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hc2\" (UniqueName: \"kubernetes.io/projected/e9f7011b-561c-438e-83f6-d9a9c076a92a-kube-api-access-c4hc2\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.593590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dhf\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593637    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9f7011b-561c-438e-83f6-d9a9c076a92a-tmp-dir\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f7011b-561c-438e-83f6-d9a9c076a92a-config-volume\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.593837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.594117 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.593875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c39885ba-6190-41d6-bf7c-02f0cc147a8e-cert\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.594117 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:48.594001    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:39:48.594117 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.594033    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.594117 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:48.594101    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.094085655 +0000 UTC m=+36.099651853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:39:48.594404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.594377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9f7011b-561c-438e-83f6-d9a9c076a92a-config-volume\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.594598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.594567    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.597719 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.597622    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.597837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.597796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.609793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.609743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hc2\" (UniqueName: \"kubernetes.io/projected/e9f7011b-561c-438e-83f6-d9a9c076a92a-kube-api-access-c4hc2\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:48.610097 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.610073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.610245 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.610174    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dhf\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:48.675277 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.675235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:48.695156 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.695118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c39885ba-6190-41d6-bf7c-02f0cc147a8e-cert\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.695311 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.695194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plz59\" (UniqueName: \"kubernetes.io/projected/c39885ba-6190-41d6-bf7c-02f0cc147a8e-kube-api-access-plz59\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.698189 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.698167    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c39885ba-6190-41d6-bf7c-02f0cc147a8e-cert\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.705571 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.705543    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plz59\" (UniqueName: \"kubernetes.io/projected/c39885ba-6190-41d6-bf7c-02f0cc147a8e-kube-api-access-plz59\") pod \"ingress-canary-6bpgv\" (UID: \"c39885ba-6190-41d6-bf7c-02f0cc147a8e\") " pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.738837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.738790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bpgv"
Jul 07 16:39:48.768246 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.768215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:48.906628 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:48.906432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bpgv"]
Jul 07 16:39:48.909414 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:48.909392    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39885ba_6190_41d6_bf7c_02f0cc147a8e.slice/crio-e047386d597d3c7d03fd20da55f9d843d6ff3326863d21c12abfb9bc4613f2e9 WatchSource:0}: Error finding container e047386d597d3c7d03fd20da55f9d843d6ff3326863d21c12abfb9bc4613f2e9: Status 404 returned error can't find the container with id e047386d597d3c7d03fd20da55f9d843d6ff3326863d21c12abfb9bc4613f2e9
Jul 07 16:39:49.031368 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.031342    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"]
Jul 07 16:39:49.034389 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.034372    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"]
Jul 07 16:39:49.034505 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.034489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.037471 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.037453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.038168 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.038150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 16:39:49.038262 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.038194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fqfzx\""
Jul 07 16:39:49.038324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.038150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.038411 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.038396    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.041353 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.041320    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 16:39:49.041353 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.041336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.041598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.041576    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hc4dp\""
Jul 07 16:39:49.041723 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.041618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 16:39:49.041723 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.041667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.045803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.045745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"]
Jul 07 16:39:49.046460 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.046442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"]
Jul 07 16:39:49.099056 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.099031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:49.099186 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.099070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:49.099186 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.099185    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:39:49.099284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.099190    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:39:49.099284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.099252    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.099233399 +0000 UTC m=+37.104799597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:39:49.099284 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.099195    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:39:49.099433 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.099315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.099304117 +0000 UTC m=+37.104870302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:39:49.133642 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.133613    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"]
Jul 07 16:39:49.136529 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.136511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"
Jul 07 16:39:49.138971 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.138950    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"]
Jul 07 16:39:49.139299 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.139285    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.139360 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.139289    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.139360 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.139322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lxgfj\""
Jul 07 16:39:49.141781 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.141760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"
Jul 07 16:39:49.144112 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.143633    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8kwr8"]
Jul 07 16:39:49.147160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.146401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wz58w\""
Jul 07 16:39:49.149168 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.149146    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56db5cb645-4dpnk"]
Jul 07 16:39:49.150051 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.149455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.152452 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.152426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.153352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.152728    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.153352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.152947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wrbwc\""
Jul 07 16:39:49.153352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.153267    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"]
Jul 07 16:39:49.153472 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.153381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.154613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.154596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 16:39:49.154613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.154605    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 16:39:49.156453 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.156436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"]
Jul 07 16:39:49.156522 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.156467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"]
Jul 07 16:39:49.156571 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.156556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.156906 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.156889    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.156993 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.156933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 16:39:49.157867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.157846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 16:39:49.158074 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.158020    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 16:39:49.158074 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.158061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ddn5w\""
Jul 07 16:39:49.158240 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.158107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 16:39:49.158364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.158344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.159203 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.159115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.159312 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.159207    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-txzcf\""
Jul 07 16:39:49.159554 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.159537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 16:39:49.159720 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.159655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 16:39:49.159832 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.159798    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.161560 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.161543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 16:39:49.166175 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.166153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8kwr8"]
Jul 07 16:39:49.166989 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.166970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"]
Jul 07 16:39:49.169263 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.169243    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56db5cb645-4dpnk"]
Jul 07 16:39:49.199757 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.199736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e016fb5-877d-4765-b8ef-304ff7fc130d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.199873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.199762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8lnt\" (UniqueName: \"kubernetes.io/projected/0e016fb5-877d-4765-b8ef-304ff7fc130d-kube-api-access-x8lnt\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.199873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.199782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.199873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.199800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fqbs\" (UniqueName: \"kubernetes.io/projected/2ef500d3-34a3-4cc6-a911-0d76e73951ca-kube-api-access-6fqbs\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.199981 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.199928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e016fb5-877d-4765-b8ef-304ff7fc130d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.234245 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.234218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"]
Jul 07 16:39:49.237216 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.237202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.243427 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.243409    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 16:39:49.243683 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.243665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 16:39:49.243763 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.243708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.244060 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.244045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.244129 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.244091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k86jl\""
Jul 07 16:39:49.257522 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.257498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"]
Jul 07 16:39:49.300677 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qdrl\" (UniqueName: \"kubernetes.io/projected/9ae08890-087b-437c-9b80-892f14c498bb-kube-api-access-7qdrl\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.300677 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.300883 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-default-certificate\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.300883 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzm2\" (UniqueName: \"kubernetes.io/projected/f913e403-bc5d-489c-8412-a1df7d683f7c-kube-api-access-5hzm2\") pod \"network-check-source-989f8b8dc-hsdkl\" (UID: \"f913e403-bc5d-489c-8412-a1df7d683f7c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"
Jul 07 16:39:49.300883 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-stats-auth\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.300883 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lpw\" (UniqueName: \"kubernetes.io/projected/947dfa27-8b2a-43bc-9041-4b11b9260707-kube-api-access-f2lpw\") pod \"volume-data-source-validator-5d456fdbcd-hkxdz\" (UID: \"947dfa27-8b2a-43bc-9041-4b11b9260707\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"
Jul 07 16:39:49.301030 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9ae08890-087b-437c-9b80-892f14c498bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.301030 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8lnt\" (UniqueName: \"kubernetes.io/projected/0e016fb5-877d-4765-b8ef-304ff7fc130d-kube-api-access-x8lnt\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.301030 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-snapshots\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301030 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.300981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e016fb5-877d-4765-b8ef-304ff7fc130d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.301030 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-tmp\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e016fb5-877d-4765-b8ef-304ff7fc130d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.301191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.301191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.301191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6bxg\" (UniqueName: \"kubernetes.io/projected/b6f211a4-adcc-4101-8ede-164e5ffe1995-kube-api-access-z6bxg\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301415 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fqbs\" (UniqueName: \"kubernetes.io/projected/2ef500d3-34a3-4cc6-a911-0d76e73951ca-kube-api-access-6fqbs\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.301415 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.301415 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqvg2\" (UniqueName: \"kubernetes.io/projected/5d11a057-0702-482e-8de5-58ae4048cc56-kube-api-access-jqvg2\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.301415 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f211a4-adcc-4101-8ede-164e5ffe1995-serving-cert\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301415 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.301584 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.301447    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:39:49.301584 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.301532    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.8015126 +0000 UTC m=+36.807078801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:39:49.301713 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.301697    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e016fb5-877d-4765-b8ef-304ff7fc130d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.303978 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.303962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e016fb5-877d-4765-b8ef-304ff7fc130d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.311590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.311569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fqbs\" (UniqueName: \"kubernetes.io/projected/2ef500d3-34a3-4cc6-a911-0d76e73951ca-kube-api-access-6fqbs\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.314552 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.314534    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8lnt\" (UniqueName: \"kubernetes.io/projected/0e016fb5-877d-4765-b8ef-304ff7fc130d-kube-api-access-x8lnt\") pod \"kube-storage-version-migrator-operator-846bf668f7-5fskp\" (UID: \"0e016fb5-877d-4765-b8ef-304ff7fc130d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.337302 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.337280    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"]
Jul 07 16:39:49.340705 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.340690    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-x4rpf"]
Jul 07 16:39:49.340846 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.340831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.343418 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.343404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.343882 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.343865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 16:39:49.343955 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.343910    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dw89d\""
Jul 07 16:39:49.343955 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.343944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 16:39:49.345838 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.345798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 16:39:49.346505 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.346229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 16:39:49.346545 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.346525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-stdbw\""
Jul 07 16:39:49.346585 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.346547    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:39:49.347455 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.347213    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 16:39:49.353697 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.353442    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 16:39:49.354250 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.354229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"]
Jul 07 16:39:49.355489 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.355465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-x4rpf"]
Jul 07 16:39:49.378900 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.378875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"
Jul 07 16:39:49.393426 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.393395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:49.402317 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qdrl\" (UniqueName: \"kubernetes.io/projected/9ae08890-087b-437c-9b80-892f14c498bb-kube-api-access-7qdrl\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.402416 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.402416 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-default-certificate\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.402506 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzm2\" (UniqueName: \"kubernetes.io/projected/f913e403-bc5d-489c-8412-a1df7d683f7c-kube-api-access-5hzm2\") pod \"network-check-source-989f8b8dc-hsdkl\" (UID: \"f913e403-bc5d-489c-8412-a1df7d683f7c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"
Jul 07 16:39:49.402506 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-stats-auth\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.402506 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lpw\" (UniqueName: \"kubernetes.io/projected/947dfa27-8b2a-43bc-9041-4b11b9260707-kube-api-access-f2lpw\") pod \"volume-data-source-validator-5d456fdbcd-hkxdz\" (UID: \"947dfa27-8b2a-43bc-9041-4b11b9260707\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"
Jul 07 16:39:49.402647 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.402526    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.902504531 +0000 UTC m=+36.908070732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:39:49.402647 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9ae08890-087b-437c-9b80-892f14c498bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.402748 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-snapshots\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.402748 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.402748 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-tmp\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.402897 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.402897 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.402897 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvr6\" (UniqueName: \"kubernetes.io/projected/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-kube-api-access-trvr6\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.402897 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-config\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.403084 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6bxg\" (UniqueName: \"kubernetes.io/projected/b6f211a4-adcc-4101-8ede-164e5ffe1995-kube-api-access-z6bxg\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.403084 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqvg2\" (UniqueName: \"kubernetes.io/projected/5d11a057-0702-482e-8de5-58ae4048cc56-kube-api-access-jqvg2\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.403084 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.402990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f211a4-adcc-4101-8ede-164e5ffe1995-serving-cert\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.403084 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.403084 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.403326 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403274    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-tmp\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.403326 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.403296    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:39:49.403424 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403342    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6f211a4-adcc-4101-8ede-164e5ffe1995-snapshots\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.403424 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.403401    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.903364361 +0000 UTC m=+36.908930554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:39:49.403528 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9ae08890-087b-437c-9b80-892f14c498bb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.403528 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.403491    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:49.403616 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.403534    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:39:49.903521047 +0000 UTC m=+36.909087239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:49.403849 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403826    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.404018 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.403999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f211a4-adcc-4101-8ede-164e5ffe1995-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.405711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.405677    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f211a4-adcc-4101-8ede-164e5ffe1995-serving-cert\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.405802 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.405710    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-stats-auth\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.405996 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.405976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-default-certificate\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.414782 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.414760    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6bxg\" (UniqueName: \"kubernetes.io/projected/b6f211a4-adcc-4101-8ede-164e5ffe1995-kube-api-access-z6bxg\") pod \"insights-operator-5c847dcfc4-8kwr8\" (UID: \"b6f211a4-adcc-4101-8ede-164e5ffe1995\") " pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.415045 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.415024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzm2\" (UniqueName: \"kubernetes.io/projected/f913e403-bc5d-489c-8412-a1df7d683f7c-kube-api-access-5hzm2\") pod \"network-check-source-989f8b8dc-hsdkl\" (UID: \"f913e403-bc5d-489c-8412-a1df7d683f7c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"
Jul 07 16:39:49.415226 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.415209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqvg2\" (UniqueName: \"kubernetes.io/projected/5d11a057-0702-482e-8de5-58ae4048cc56-kube-api-access-jqvg2\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.415368 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.415351    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qdrl\" (UniqueName: \"kubernetes.io/projected/9ae08890-087b-437c-9b80-892f14c498bb-kube-api-access-7qdrl\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.415602 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.415586    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lpw\" (UniqueName: \"kubernetes.io/projected/947dfa27-8b2a-43bc-9041-4b11b9260707-kube-api-access-f2lpw\") pod \"volume-data-source-validator-5d456fdbcd-hkxdz\" (UID: \"947dfa27-8b2a-43bc-9041-4b11b9260707\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"
Jul 07 16:39:49.448851 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.448827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"
Jul 07 16:39:49.457075 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.457038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"
Jul 07 16:39:49.463931 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.463913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8"
Jul 07 16:39:49.473888 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.473838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d999d753-9841-4265-b2c5-ce2d4fb17312-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tgql\" (UniqueName: \"kubernetes.io/projected/9c6cbd48-6b0b-43d1-8fef-47be53512af9-kube-api-access-2tgql\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvr6\" (UniqueName: \"kubernetes.io/projected/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-kube-api-access-trvr6\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-config\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-config\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-trusted-ca\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.505166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.504975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c6cbd48-6b0b-43d1-8fef-47be53512af9-serving-cert\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.505727 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.505650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-config\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.508700 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.508617    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.519785 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.517781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp"]
Jul 07 16:39:49.532089 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.526326    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvr6\" (UniqueName: \"kubernetes.io/projected/4d9e7270-6ec5-48bc-8b20-ea9e38d32a75-kube-api-access-trvr6\") pod \"service-ca-operator-5d46d9ffd4-s8mkf\" (UID: \"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.545696 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.545492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"
Jul 07 16:39:49.577430 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.577213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:49.605841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-config\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.605841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-trusted-ca\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.605841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c6cbd48-6b0b-43d1-8fef-47be53512af9-serving-cert\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.605841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.605841 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d999d753-9841-4265-b2c5-ce2d4fb17312-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.606237 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.605863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tgql\" (UniqueName: \"kubernetes.io/projected/9c6cbd48-6b0b-43d1-8fef-47be53512af9-kube-api-access-2tgql\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.609621 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.606951    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-config\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.609621 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.607245    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:39:49.609621 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.607319    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.10730123 +0000 UTC m=+37.112867432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:39:49.609621 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.608513    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c6cbd48-6b0b-43d1-8fef-47be53512af9-trusted-ca\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.609621 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.609116    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d999d753-9841-4265-b2c5-ce2d4fb17312-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:49.616799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.616747    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c6cbd48-6b0b-43d1-8fef-47be53512af9-serving-cert\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.619492 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.619432    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tgql\" (UniqueName: \"kubernetes.io/projected/9c6cbd48-6b0b-43d1-8fef-47be53512af9-kube-api-access-2tgql\") pod \"console-operator-68b757fb67-x4rpf\" (UID: \"9c6cbd48-6b0b-43d1-8fef-47be53512af9\") " pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.644980 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.644844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz"]
Jul 07 16:39:49.653886 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:49.653850    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947dfa27_8b2a_43bc_9041_4b11b9260707.slice/crio-06057275061b949a6fc23d0c9d62959395d1209b9283a4f4c69116acd0599a6d WatchSource:0}: Error finding container 06057275061b949a6fc23d0c9d62959395d1209b9283a4f4c69116acd0599a6d: Status 404 returned error can't find the container with id 06057275061b949a6fc23d0c9d62959395d1209b9283a4f4c69116acd0599a6d
Jul 07 16:39:49.658079 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.658008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bpgv" event={"ID":"c39885ba-6190-41d6-bf7c-02f0cc147a8e","Type":"ContainerStarted","Data":"e047386d597d3c7d03fd20da55f9d843d6ff3326863d21c12abfb9bc4613f2e9"}
Jul 07 16:39:49.658424 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.658402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:49.661225 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.661202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl"]
Jul 07 16:39:49.662423 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.662363    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="3e994751c9cae7dffb131dc0ee5ca248fa5502778d459b0b6057ba9d6034ce85" exitCode=0
Jul 07 16:39:49.662494 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.662452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"3e994751c9cae7dffb131dc0ee5ca248fa5502778d459b0b6057ba9d6034ce85"}
Jul 07 16:39:49.667681 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:49.667127    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf913e403_bc5d_489c_8412_a1df7d683f7c.slice/crio-1b7097e53a236e6d93f8e7808f75039aa94e66c4d454ba63cd819b1c95a2869f WatchSource:0}: Error finding container 1b7097e53a236e6d93f8e7808f75039aa94e66c4d454ba63cd819b1c95a2869f: Status 404 returned error can't find the container with id 1b7097e53a236e6d93f8e7808f75039aa94e66c4d454ba63cd819b1c95a2869f
Jul 07 16:39:49.669118 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.668946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:49.671878 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.671795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp" event={"ID":"0e016fb5-877d-4765-b8ef-304ff7fc130d","Type":"ContainerStarted","Data":"3def8ff9a00dc8dcf76cbfb1462051334875424facc063018ce4fb90df5bdc17"}
Jul 07 16:39:49.676022 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.676004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8kwr8"]
Jul 07 16:39:49.681352 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:49.681246    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f211a4_adcc_4101_8ede_164e5ffe1995.slice/crio-a6f71056ec1eedceb14aa84b9cebc0ec4cfaffbbbdabf1289363108a79bb8624 WatchSource:0}: Error finding container a6f71056ec1eedceb14aa84b9cebc0ec4cfaffbbbdabf1289363108a79bb8624: Status 404 returned error can't find the container with id a6f71056ec1eedceb14aa84b9cebc0ec4cfaffbbbdabf1289363108a79bb8624
Jul 07 16:39:49.723342 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.723314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf"]
Jul 07 16:39:49.726375 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:49.726349    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9e7270_6ec5_48bc_8b20_ea9e38d32a75.slice/crio-622da7862e88b2ce5b0e4cb8fee4f9b8e99cc575c7b3470a50baa7972d72e514 WatchSource:0}: Error finding container 622da7862e88b2ce5b0e4cb8fee4f9b8e99cc575c7b3470a50baa7972d72e514: Status 404 returned error can't find the container with id 622da7862e88b2ce5b0e4cb8fee4f9b8e99cc575c7b3470a50baa7972d72e514
Jul 07 16:39:49.807548 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.807523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:49.808009 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.807988    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:39:49.808085 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.808053    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.808036441 +0000 UTC m=+37.813602642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:39:49.830685 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.830655    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-x4rpf"]
Jul 07 16:39:49.854770 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:39:49.854742    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6cbd48_6b0b_43d1_8fef_47be53512af9.slice/crio-8a6d8759a36621e5f878cd027f341f83c3001bee21dd622b370f8f09d9171b59 WatchSource:0}: Error finding container 8a6d8759a36621e5f878cd027f341f83c3001bee21dd622b370f8f09d9171b59: Status 404 returned error can't find the container with id 8a6d8759a36621e5f878cd027f341f83c3001bee21dd622b370f8f09d9171b59
Jul 07 16:39:49.909089 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.909025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.909089 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.909058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:49.909265 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:49.909143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:49.909265 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.909176    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:39:49.909265 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.909236    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.909218731 +0000 UTC m=+37.914784937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:39:49.909265 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.909239    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:49.909449 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.909285    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.909272982 +0000 UTC m=+37.914839168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:49.909449 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:49.909298    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:50.90929239 +0000 UTC m=+37.914858575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:39:50.111991 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.111955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:50.112175 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.112025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:50.112175 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.112076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:50.112175 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.112127    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:39:50.112633 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.112597    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:39:50.112756 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.112691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:51.112662176 +0000 UTC m=+38.118228368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:39:50.112967 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.112952    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.112936134 +0000 UTC m=+39.118502327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:39:50.113048 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.113034    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:39:50.113115 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.113048    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:39:50.113115 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.113094    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.113082187 +0000 UTC m=+39.118648389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:39:50.680751 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.680711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf" event={"ID":"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75","Type":"ContainerStarted","Data":"622da7862e88b2ce5b0e4cb8fee4f9b8e99cc575c7b3470a50baa7972d72e514"}
Jul 07 16:39:50.685495 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.685461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8" event={"ID":"b6f211a4-adcc-4101-8ede-164e5ffe1995","Type":"ContainerStarted","Data":"a6f71056ec1eedceb14aa84b9cebc0ec4cfaffbbbdabf1289363108a79bb8624"}
Jul 07 16:39:50.687371 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.687300    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" event={"ID":"9c6cbd48-6b0b-43d1-8fef-47be53512af9","Type":"ContainerStarted","Data":"8a6d8759a36621e5f878cd027f341f83c3001bee21dd622b370f8f09d9171b59"}
Jul 07 16:39:50.693837 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.693786    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a8df170-a942-4075-89a1-e83d331f3340" containerID="91994de9444346f4736e21a40154a4bc18c689d72b4a508941447ba40f0ea187" exitCode=0
Jul 07 16:39:50.695093 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.695026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerDied","Data":"91994de9444346f4736e21a40154a4bc18c689d72b4a508941447ba40f0ea187"}
Jul 07 16:39:50.698379 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.698321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl" event={"ID":"f913e403-bc5d-489c-8412-a1df7d683f7c","Type":"ContainerStarted","Data":"1b7097e53a236e6d93f8e7808f75039aa94e66c4d454ba63cd819b1c95a2869f"}
Jul 07 16:39:50.703932 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.703877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz" event={"ID":"947dfa27-8b2a-43bc-9041-4b11b9260707","Type":"ContainerStarted","Data":"06057275061b949a6fc23d0c9d62959395d1209b9283a4f4c69116acd0599a6d"}
Jul 07 16:39:50.821044 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.819215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:50.821044 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.820536    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:39:50.821044 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.820598    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.820579245 +0000 UTC m=+39.826145436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.920846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.920898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:50.920994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.921186    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.921167431 +0000 UTC m=+39.926733623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.921605    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.921656    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.921641211 +0000 UTC m=+39.927207399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.921722    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:50.921793 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:50.921757    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:39:52.921745453 +0000 UTC m=+39.927311642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:51.123565 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:51.122857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:51.123565 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:51.123125    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:39:51.123565 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:51.123199    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:53.123178589 +0000 UTC m=+40.128744778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:39:51.712943 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:51.712266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppglm" event={"ID":"7a8df170-a942-4075-89a1-e83d331f3340","Type":"ContainerStarted","Data":"79149f5795756f8c4a87dbcb5db42d5649e8c5760c724e78540aed556d038612"}
Jul 07 16:39:51.741557 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:51.741497    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppglm" podStartSLOduration=9.605294479 podStartE2EDuration="38.741473732s" totalImagesPullingTime="29.136179253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:51.739566046 +0000 UTC m=+38.745132281" watchObservedRunningTime="2026-07-07 16:39:51.741473732 +0000 UTC m=+38.747039942"
Jul 07 16:39:51.873722 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:51.873666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:51.934504 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:51.934467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:52.133188 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.133144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:52.133377 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.133312    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:39:52.133452 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.133408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:52.133603 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.133564    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.133540257 +0000 UTC m=+43.139106456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:39:52.133603 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.133600    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:39:52.133766 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.133613    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:39:52.133766 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.133653    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.133640673 +0000 UTC m=+43.139206859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:39:52.840088 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.840003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:52.840534 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.840152    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:39:52.840534 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.840227    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.840204844 +0000 UTC m=+43.845771033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:39:52.941440 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.941391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:52.941631 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.941593    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.941569239 +0000 UTC m=+43.947135441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:39:52.941708 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.941688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:52.941765 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:52.941720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:52.941927 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.941906    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:52.942059 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.941967    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.941943464 +0000 UTC m=+43.947509650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:52.942059 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.942024    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:39:52.942187 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:52.942079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:56.942064032 +0000 UTC m=+43.947630221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:39:53.143683 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:53.143644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:53.143966 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:53.143937    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:39:53.144069 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:53.144006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:57.143987429 +0000 UTC m=+44.149553634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:39:54.761128 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:54.761092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:54.826064 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:54.826036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:55.263251 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:55.263171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:55.348203 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:55.348170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:56.171652 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.171612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.171824    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.171842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.171851    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.171911    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.171951    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.171932253 +0000 UTC m=+51.177498442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:39:56.172174 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.171971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.17196173 +0000 UTC m=+51.177527917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:39:56.375468 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.375439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:56.476132 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.476045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:56.876888 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.876853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:39:56.877032 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.877006    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:39:56.877081 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.877070    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.877054708 +0000 UTC m=+51.882620893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:39:56.977877 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.977841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:56.978021 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.977934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:39:56.978021 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:56.977951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:39:56.978089 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.978019    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.977999881 +0000 UTC m=+51.983566067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:39:56.978089 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.978059    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:56.978089 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.978060    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:39:56.978192 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.978103    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.97809274 +0000 UTC m=+51.983658927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:39:56.978192 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:56.978117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:04.97811059 +0000 UTC m=+51.983676775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:39:57.179312 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.179240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:39:57.179738 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:57.179407    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:39:57.179738 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:57.179516    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:05.179498855 +0000 UTC m=+52.185065041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:39:57.733632 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.733304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" event={"ID":"9c6cbd48-6b0b-43d1-8fef-47be53512af9","Type":"ContainerStarted","Data":"5c78792b9acece715de55bdc809db11f657b525f10bcecd04082fd1db3402181"}
Jul 07 16:39:57.735054 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.733989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:57.735256 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.735210    2565 patch_prober.go:28] interesting pod/console-operator-68b757fb67-x4rpf container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 07 16:39:57.735385 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.735262    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" podUID="9c6cbd48-6b0b-43d1-8fef-47be53512af9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.18:8443/readyz\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 07 16:39:57.736627 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.736603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bpgv" event={"ID":"c39885ba-6190-41d6-bf7c-02f0cc147a8e","Type":"ContainerStarted","Data":"0ba938a5673a1f2314c51d7d5342bc70347c6665a555fadeb6d035a1d6d17037"}
Jul 07 16:39:57.738536 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.738512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl" event={"ID":"f913e403-bc5d-489c-8412-a1df7d683f7c","Type":"ContainerStarted","Data":"2cbd93adec114938e59dccb4450e378eda7b698337552a56e0e482bc7c370f30"}
Jul 07 16:39:57.741072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.741041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz" event={"ID":"947dfa27-8b2a-43bc-9041-4b11b9260707","Type":"ContainerStarted","Data":"b0d2124887d0b1df71713a9f7c6ff706c918cd425fc014992d714ff984bc5a93"}
Jul 07 16:39:57.743059 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.742971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp" event={"ID":"0e016fb5-877d-4765-b8ef-304ff7fc130d","Type":"ContainerStarted","Data":"1f36aaf1720b7c4faa9fd240d3079237ed4eef2d08b477667ce2911ff7927992"}
Jul 07 16:39:57.745291 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.745225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf" event={"ID":"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75","Type":"ContainerStarted","Data":"59c0003fa0e4b61e9996d80b1a9fde9913e3b65cffd5432b142f9c9eb300b4bb"}
Jul 07 16:39:57.747096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.747002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8" event={"ID":"b6f211a4-adcc-4101-8ede-164e5ffe1995","Type":"ContainerStarted","Data":"0d89a4e352de88df3abff78624428f991972f03c3a197e0c6a6df585e3146920"}
Jul 07 16:39:57.756324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.755787    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" podStartSLOduration=1.333679041 podStartE2EDuration="8.755771448s" totalImagesPullingTime="7.422092407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.754600433 +0000 UTC m=+44.760166683" watchObservedRunningTime="2026-07-07 16:39:57.755771448 +0000 UTC m=+44.761337660"
Jul 07 16:39:57.777413 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.777362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp" podStartSLOduration=1.029742701 podStartE2EDuration="8.777343365s" totalImagesPullingTime="7.747600664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.777130154 +0000 UTC m=+44.782696364" watchObservedRunningTime="2026-07-07 16:39:57.777343365 +0000 UTC m=+44.782909583"
Jul 07 16:39:57.805353 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.805293    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8" podStartSLOduration=1.208885389 podStartE2EDuration="8.805273086s" totalImagesPullingTime="7.596387697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.804275947 +0000 UTC m=+44.809842175" watchObservedRunningTime="2026-07-07 16:39:57.805273086 +0000 UTC m=+44.810839275"
Jul 07 16:39:57.826064 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.826012    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf" podStartSLOduration=1.275679135 podStartE2EDuration="8.825994955s" totalImagesPullingTime="7.55031582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.825436684 +0000 UTC m=+44.831002893" watchObservedRunningTime="2026-07-07 16:39:57.825994955 +0000 UTC m=+44.831561164"
Jul 07 16:39:57.869964 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.868833    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6bpgv" podStartSLOduration=1.533239832 podStartE2EDuration="9.86878383s" totalImagesPullingTime="8.335543998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.848010314 +0000 UTC m=+44.853576523" watchObservedRunningTime="2026-07-07 16:39:57.86878383 +0000 UTC m=+44.874350040"
Jul 07 16:39:57.869964 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.868993    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hkxdz" podStartSLOduration=1.327977401 podStartE2EDuration="8.868986632s" totalImagesPullingTime="7.541009231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.86773141 +0000 UTC m=+44.873297620" watchObservedRunningTime="2026-07-07 16:39:57.868986632 +0000 UTC m=+44.874552842"
Jul 07 16:39:57.891343 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.891288    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hsdkl" podStartSLOduration=1.272662374 podStartE2EDuration="8.891267537s" totalImagesPullingTime="7.618605163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:57.888706417 +0000 UTC m=+44.894272655" watchObservedRunningTime="2026-07-07 16:39:57.891267537 +0000 UTC m=+44.896833747"
Jul 07 16:39:57.986869 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:57.986780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:58.236128 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.236094    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 16:39:58.416494 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.416376    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:39:58.23611448Z","UUID":"4e30ab2f-9989-4223-8a14-ea5cf8ed0179","Handler":null,"Name":"","Endpoint":""}
Jul 07 16:39:58.418573 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.418205    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 16:39:58.418573 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.418245    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 16:39:58.753737 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.753489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" event={"ID":"0f6bf7eb-6054-47be-85a6-e0b7fea4e798","Type":"ContainerStarted","Data":"d3148d487687ef06b451b97501db4a634778e101b425f31ec0452a5fd5fd6009"}
Jul 07 16:39:58.755261 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.755238    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/0.log"
Jul 07 16:39:58.755392 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.755281    2565 generic.go:356] "Generic (PLEG): container finished" podID="9c6cbd48-6b0b-43d1-8fef-47be53512af9" containerID="5c78792b9acece715de55bdc809db11f657b525f10bcecd04082fd1db3402181" exitCode=255
Jul 07 16:39:58.755392 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.755349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" event={"ID":"9c6cbd48-6b0b-43d1-8fef-47be53512af9","Type":"ContainerDied","Data":"5c78792b9acece715de55bdc809db11f657b525f10bcecd04082fd1db3402181"}
Jul 07 16:39:58.755589 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.755574    2565 scope.go:117] "RemoveContainer" containerID="5c78792b9acece715de55bdc809db11f657b525f10bcecd04082fd1db3402181"
Jul 07 16:39:58.789021 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.788928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:58.809395 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.809354    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x2lm2" podStartSLOduration=3.804694372 podStartE2EDuration="45.809334359s" totalImagesPullingTime="42.004639987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-07 16:39:58.808471179 +0000 UTC m=+45.814037388" watchObservedRunningTime="2026-07-07 16:39:58.809334359 +0000 UTC m=+45.814900567"
Jul 07 16:39:58.877399 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:58.877362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:59.207784 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.207751    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zg78s"]
Jul 07 16:39:59.228006 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.227975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zg78s"]
Jul 07 16:39:59.228165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.228102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.231570 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.231539    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 16:39:59.231700 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.231580    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 16:39:59.231700 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.231603    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-46nj6\""
Jul 07 16:39:59.299193 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.299162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.299729 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.299273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.299729 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.299305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-crio-socket\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.299729 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.299330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-774xj\" (UniqueName: \"kubernetes.io/projected/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-api-access-774xj\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.299729 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.299401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-data-volume\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400253 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-774xj\" (UniqueName: \"kubernetes.io/projected/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-api-access-774xj\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-data-volume\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-crio-socket\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400584 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.400502    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:39:59.400584 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400582    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-crio-socket\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400671 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.400504    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:39:59.400671 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.400593    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:39:59.900572435 +0000 UTC m=+46.906138642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : configmap "kube-rbac-proxy" not found
Jul 07 16:39:59.400671 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.400651    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-data-volume\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.400671 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.400672    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:39:59.900654046 +0000 UTC m=+46.906220246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:39:59.421834 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.421797    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-774xj\" (UniqueName: \"kubernetes.io/projected/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-api-access-774xj\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.506926 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.506849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:59.609961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.609932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:59.659199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.659170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:39:59.760240 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:39:59.760618 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/0.log"
Jul 07 16:39:59.760713 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760639    2565 generic.go:356] "Generic (PLEG): container finished" podID="9c6cbd48-6b0b-43d1-8fef-47be53512af9" containerID="66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f" exitCode=255
Jul 07 16:39:59.760713 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" event={"ID":"9c6cbd48-6b0b-43d1-8fef-47be53512af9","Type":"ContainerDied","Data":"66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f"}
Jul 07 16:39:59.760850 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760719    2565 scope.go:117] "RemoveContainer" containerID="5c78792b9acece715de55bdc809db11f657b525f10bcecd04082fd1db3402181"
Jul 07 16:39:59.760994 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.760976    2565 scope.go:117] "RemoveContainer" containerID="66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f"
Jul 07 16:39:59.761232 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.761211    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-x4rpf_openshift-console-operator(9c6cbd48-6b0b-43d1-8fef-47be53512af9)\"" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" podUID="9c6cbd48-6b0b-43d1-8fef-47be53512af9"
Jul 07 16:39:59.773686 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.773661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:59.869855 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.869795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:39:59.904172 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.904149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.904273 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:39:59.904199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:39:59.904307 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.904293    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:39:59.904357 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.904347    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:00.904332867 +0000 UTC m=+47.909899053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:39:59.904401 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.904354    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:39:59.904401 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:39:59.904392    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:00.904381788 +0000 UTC m=+47.909947974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : configmap "kube-rbac-proxy" not found
Jul 07 16:40:00.349116 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.349081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:00.764953 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.764926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:40:00.765255 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.765240    2565 scope.go:117] "RemoveContainer" containerID="66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f"
Jul 07 16:40:00.765406 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:00.765388    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-x4rpf_openshift-console-operator(9c6cbd48-6b0b-43d1-8fef-47be53512af9)\"" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" podUID="9c6cbd48-6b0b-43d1-8fef-47be53512af9"
Jul 07 16:40:00.795087 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.795062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5f6ts_4292bfec-88b4-4129-b64d-b158026e3d2e/dns-node-resolver/0.log"
Jul 07 16:40:00.913564 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.913527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:00.913732 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:00.913650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:00.913732 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:00.913668    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:40:00.913904 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:00.913745    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:02.91372499 +0000 UTC m=+49.919291176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : configmap "kube-rbac-proxy" not found
Jul 07 16:40:00.913904 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:00.913752    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:00.913904 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:00.913789    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:02.913779354 +0000 UTC m=+49.919345541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:01.090541 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:01.090461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:01.147002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:01.146973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:01.596900 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:01.596878    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6nzd8_c072679b-a7a8-42f0-97df-289ec7399e48/node-ca/0.log"
Jul 07 16:40:02.134500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:02.134464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:02.398556 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:02.398482    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bpgv_c39885ba-6190-41d6-bf7c-02f0cc147a8e/serve-healthcheck-canary/0.log"
Jul 07 16:40:02.932211 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:02.932174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:02.932588 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:02.932240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:02.932588 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:02.932333    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:40:02.932588 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:02.932358    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:02.932588 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:02.932430    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:06.932416167 +0000 UTC m=+53.937982352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : configmap "kube-rbac-proxy" not found
Jul 07 16:40:02.932588 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:02.932443    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:06.932437382 +0000 UTC m=+53.938003568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:04.243727 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:04.243689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:04.243752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.243861    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.243923    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls podName:e9f7011b-561c-438e-83f6-d9a9c076a92a nodeName:}" failed. No retries permitted until 2026-07-07 16:40:20.243906906 +0000 UTC m=+67.249473092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls") pod "dns-default-jwq82" (UID: "e9f7011b-561c-438e-83f6-d9a9c076a92a") : secret "dns-default-metrics-tls" not found
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.243928    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.243942    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c8bcb6b-cmkjx: secret "image-registry-tls" not found
Jul 07 16:40:04.244102 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.243983    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls podName:6882cd3f-8b7a-458c-81b7-8a94de5dd0d5 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:20.243969522 +0000 UTC m=+67.249535717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls") pod "image-registry-58c8bcb6b-cmkjx" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5") : secret "image-registry-tls" not found
Jul 07 16:40:04.950220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:04.950184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:40:04.950390 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.950339    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 16:40:04.950429 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:04.950402    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls podName:2ef500d3-34a3-4cc6-a911-0d76e73951ca nodeName:}" failed. No retries permitted until 2026-07-07 16:40:20.950387817 +0000 UTC m=+67.955954003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fkzss" (UID: "2ef500d3-34a3-4cc6-a911-0d76e73951ca") : secret "samples-operator-tls" not found
Jul 07 16:40:05.051609 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:05.051578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:05.051774 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:05.051703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:05.051774 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.051733    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:21.051714958 +0000 UTC m=+68.057281165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : configmap references non-existent config key: service-ca.crt
Jul 07 16:40:05.051774 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:05.051757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:40:05.051916 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.051792    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:40:05.051916 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.051853    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs podName:5d11a057-0702-482e-8de5-58ae4048cc56 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:21.051838669 +0000 UTC m=+68.057404861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs") pod "router-default-56db5cb645-4dpnk" (UID: "5d11a057-0702-482e-8de5-58ae4048cc56") : secret "router-metrics-certs-default" not found
Jul 07 16:40:05.051916 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.051861    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 16:40:05.051916 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.051897    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls podName:9ae08890-087b-437c-9b80-892f14c498bb nodeName:}" failed. No retries permitted until 2026-07-07 16:40:21.051890201 +0000 UTC m=+68.057456388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pqw88" (UID: "9ae08890-087b-437c-9b80-892f14c498bb") : secret "cluster-monitoring-operator-tls" not found
Jul 07 16:40:05.253496 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:05.253414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:40:05.253861 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.253573    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:40:05.253861 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:05.253637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert podName:d999d753-9841-4265-b2c5-ce2d4fb17312 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:21.253623448 +0000 UTC m=+68.259189634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-ln52p" (UID: "d999d753-9841-4265-b2c5-ce2d4fb17312") : secret "networking-console-plugin-cert" not found
Jul 07 16:40:05.710608 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:05.710565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.111482 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.111405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.213430 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.213394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.312495 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.312455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.412117 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.412078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.519414 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.519371    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.831102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.831006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:06.966529 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.966495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:06.966698 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:06.966557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:06.966698 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:06.966661    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:40:06.966698 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:06.966664    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:06.966844 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:06.966709    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:14.966697099 +0000 UTC m=+61.972263286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : configmap "kube-rbac-proxy" not found
Jul 07 16:40:06.966844 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:06.966723    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:14.966717535 +0000 UTC m=+61.972283720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:07.603483 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:07.603449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:07.734595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:07.734561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:40:07.734995 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:07.734981    2565 scope.go:117] "RemoveContainer" containerID="66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f"
Jul 07 16:40:07.735141 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:07.735124    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-x4rpf_openshift-console-operator(9c6cbd48-6b0b-43d1-8fef-47be53512af9)\"" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" podUID="9c6cbd48-6b0b-43d1-8fef-47be53512af9"
Jul 07 16:40:07.993075 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:07.993037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:08.193147 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:08.193110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:08.791784 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:08.791747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.412363 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.412318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.597096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.597048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.658889 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.658858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:40:09.659327 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.659310    2565 scope.go:117] "RemoveContainer" containerID="66cff4af142412110452aacfd73c5b46585b0325c4c8da0c92409d2f96bc454f"
Jul 07 16:40:09.756833 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.756782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.799478 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.799455    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:40:09.799971 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.799528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf" event={"ID":"9c6cbd48-6b0b-43d1-8fef-47be53512af9","Type":"ContainerStarted","Data":"1c4d6fef7e39857dbf1cc256f997c3a6cec49a8d47b944f61e0d38e988d1f105"}
Jul 07 16:40:09.799971 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.799831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:40:09.819964 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.819922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.893366 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.893327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:09.995032 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:09.994943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.015336 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.015307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-x4rpf"
Jul 07 16:40:10.196040 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.196009    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.299079 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.298993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.398606 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.398573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.503736 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.503709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.606059 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.605978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.663588 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.663555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:10.876796 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:10.876771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:11.292599 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:11.292517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:11.401990 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:11.401953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:11.708659 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:11.708620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:11.808350 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:11.808317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:11.909444 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:11.909416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.009174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.009098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.110195 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.110165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.214306 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.214271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.311844 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.311728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.413273 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.413233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:12.512474 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:12.512435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.047779 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.047743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.113542 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.113509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.408162 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.408125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.811467 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.811349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.937972 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.937938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:13.998370 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:13.998337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:14.204467 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:14.204425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:14.400422 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:14.400387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:14.650966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:14.650939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhccm"
Jul 07 16:40:14.713163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:14.713127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:14.777217 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:14.777156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:15.037311 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.037221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:15.037311 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.037286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:15.037513 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:15.037439    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:15.037551 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:15.037517    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls podName:eef9ecfc-9e21-49c7-bb62-da0b71e20ffe nodeName:}" failed. No retries permitted until 2026-07-07 16:40:31.037498789 +0000 UTC m=+78.043064976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg78s" (UID: "eef9ecfc-9e21-49c7-bb62-da0b71e20ffe") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:40:15.037799 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.037771    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:15.470991 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.470959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:15.793668 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.793583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:15.998281 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:15.998251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:16.192229 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:16.192197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:16.394667 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:16.394629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:16.995772 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:16.995732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:17.214113 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:17.214082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:19.272097 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.272057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:40:19.272636 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.272171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:40:19.275065 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.275049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:40:19.275119 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.275049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:40:19.284490 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.284462    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deb5fca9-079a-4da2-9ee3-3230e475257a-metrics-certs\") pod \"network-metrics-daemon-wrp9n\" (UID: \"deb5fca9-079a-4da2-9ee3-3230e475257a\") " pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:40:19.284490 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.284487    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4214a03-83cb-49df-889b-0e098d963c07-original-pull-secret\") pod \"global-pull-secret-syncer-mn7vv\" (UID: \"f4214a03-83cb-49df-889b-0e098d963c07\") " pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:40:19.373487 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.373439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:40:19.375906 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.375882    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgmdv\" (UniqueName: \"kubernetes.io/projected/db59a98a-0b1f-46c8-877a-035df742efc2-kube-api-access-hgmdv\") pod \"network-check-target-22ddz\" (UID: \"db59a98a-0b1f-46c8-877a-035df742efc2\") " pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:40:19.406581 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.406560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctnwh\""
Jul 07 16:40:19.410615 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.410592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mn7vv"
Jul 07 16:40:19.413859 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.413841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:40:19.419275 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.419256    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5w7gr\""
Jul 07 16:40:19.427081 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.427059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrp9n"
Jul 07 16:40:19.562454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.562369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mn7vv"]
Jul 07 16:40:19.563460 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:19.563435    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4214a03_83cb_49df_889b_0e098d963c07.slice/crio-a4ad38bf93bb4ac72ea9c5f1dd2cb7611bc7eb16ab4d3561429ad0194aed73e8 WatchSource:0}: Error finding container a4ad38bf93bb4ac72ea9c5f1dd2cb7611bc7eb16ab4d3561429ad0194aed73e8: Status 404 returned error can't find the container with id a4ad38bf93bb4ac72ea9c5f1dd2cb7611bc7eb16ab4d3561429ad0194aed73e8
Jul 07 16:40:19.574791 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.574768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22ddz"]
Jul 07 16:40:19.577131 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:19.577109    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb59a98a_0b1f_46c8_877a_035df742efc2.slice/crio-7814b5fd0d3d97fc442c00bfec95d4312a2adf82ca7e5a0285559f911be02941 WatchSource:0}: Error finding container 7814b5fd0d3d97fc442c00bfec95d4312a2adf82ca7e5a0285559f911be02941: Status 404 returned error can't find the container with id 7814b5fd0d3d97fc442c00bfec95d4312a2adf82ca7e5a0285559f911be02941
Jul 07 16:40:19.592555 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.592540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrp9n"]
Jul 07 16:40:19.594305 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:19.594266    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb5fca9_079a_4da2_9ee3_3230e475257a.slice/crio-67e1cbda5763b409e2469e7b849f8e0cb4a2caee0e64e709311b41cba21f2961 WatchSource:0}: Error finding container 67e1cbda5763b409e2469e7b849f8e0cb4a2caee0e64e709311b41cba21f2961: Status 404 returned error can't find the container with id 67e1cbda5763b409e2469e7b849f8e0cb4a2caee0e64e709311b41cba21f2961
Jul 07 16:40:19.830296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.830205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22ddz" event={"ID":"db59a98a-0b1f-46c8-877a-035df742efc2","Type":"ContainerStarted","Data":"0d8c64c4e2b9066c375bc5a4306138b263cf9e7f0963b8e8fa01deb593a235c6"}
Jul 07 16:40:19.830296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.830253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22ddz" event={"ID":"db59a98a-0b1f-46c8-877a-035df742efc2","Type":"ContainerStarted","Data":"7814b5fd0d3d97fc442c00bfec95d4312a2adf82ca7e5a0285559f911be02941"}
Jul 07 16:40:19.830296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.830277    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:40:19.833838 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.831726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrp9n" event={"ID":"deb5fca9-079a-4da2-9ee3-3230e475257a","Type":"ContainerStarted","Data":"67e1cbda5763b409e2469e7b849f8e0cb4a2caee0e64e709311b41cba21f2961"}
Jul 07 16:40:19.836318 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.836296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mn7vv" event={"ID":"f4214a03-83cb-49df-889b-0e098d963c07","Type":"ContainerStarted","Data":"a4ad38bf93bb4ac72ea9c5f1dd2cb7611bc7eb16ab4d3561429ad0194aed73e8"}
Jul 07 16:40:19.846693 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:19.846647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-22ddz" podStartSLOduration=66.846633616 podStartE2EDuration="1m6.846633616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:19.846299577 +0000 UTC m=+66.851865785" watchObservedRunningTime="2026-07-07 16:40:19.846633616 +0000 UTC m=+66.852199824"
Jul 07 16:40:20.281687 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.281642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:20.282209 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.281718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:20.284739 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.284713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"image-registry-58c8bcb6b-cmkjx\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") " pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:20.284859 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.284800    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9f7011b-561c-438e-83f6-d9a9c076a92a-metrics-tls\") pod \"dns-default-jwq82\" (UID: \"e9f7011b-561c-438e-83f6-d9a9c076a92a\") " pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:20.522463 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.522433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-45v4k\""
Jul 07 16:40:20.529728 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.529707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:20.534968 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.534913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z577\""
Jul 07 16:40:20.542715 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.542691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:20.716425 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.716342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:40:20.721707 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:20.721674    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6882cd3f_8b7a_458c_81b7_8a94de5dd0d5.slice/crio-22ee2a9eb736a0b6d813ce8cf4e05cc1f475af10a4cc0480f8dfa993feaf1686 WatchSource:0}: Error finding container 22ee2a9eb736a0b6d813ce8cf4e05cc1f475af10a4cc0480f8dfa993feaf1686: Status 404 returned error can't find the container with id 22ee2a9eb736a0b6d813ce8cf4e05cc1f475af10a4cc0480f8dfa993feaf1686
Jul 07 16:40:20.738059 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.737960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwq82"]
Jul 07 16:40:20.740632 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:20.740603    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f7011b_561c_438e_83f6_d9a9c076a92a.slice/crio-7c6e0a9563e99befd4114f5db85b41a8ee10bacd24aaab0f866de99f9e53720d WatchSource:0}: Error finding container 7c6e0a9563e99befd4114f5db85b41a8ee10bacd24aaab0f866de99f9e53720d: Status 404 returned error can't find the container with id 7c6e0a9563e99befd4114f5db85b41a8ee10bacd24aaab0f866de99f9e53720d
Jul 07 16:40:20.842788 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.842719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwq82" event={"ID":"e9f7011b-561c-438e-83f6-d9a9c076a92a","Type":"ContainerStarted","Data":"7c6e0a9563e99befd4114f5db85b41a8ee10bacd24aaab0f866de99f9e53720d"}
Jul 07 16:40:20.844620 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.844561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" event={"ID":"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5","Type":"ContainerStarted","Data":"22ee2a9eb736a0b6d813ce8cf4e05cc1f475af10a4cc0480f8dfa993feaf1686"}
Jul 07 16:40:20.989860 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.989801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:40:20.993118 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:20.993065    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ef500d3-34a3-4cc6-a911-0d76e73951ca-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fkzss\" (UID: \"2ef500d3-34a3-4cc6-a911-0d76e73951ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:40:21.091244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.091142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:21.091407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.091246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:21.091407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.091274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:40:21.091943 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.091887    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d11a057-0702-482e-8de5-58ae4048cc56-service-ca-bundle\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:21.094044 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.094023    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d11a057-0702-482e-8de5-58ae4048cc56-metrics-certs\") pod \"router-default-56db5cb645-4dpnk\" (UID: \"5d11a057-0702-482e-8de5-58ae4048cc56\") " pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:21.094651 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.094628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ae08890-087b-437c-9b80-892f14c498bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pqw88\" (UID: \"9ae08890-087b-437c-9b80-892f14c498bb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:40:21.177044 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.177012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fqfzx\""
Jul 07 16:40:21.184534 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.184510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"
Jul 07 16:40:21.275007 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.274981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ddn5w\""
Jul 07 16:40:21.279643 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.279619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-txzcf\""
Jul 07 16:40:21.282927 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.282791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:21.288134 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.288112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"
Jul 07 16:40:21.292686 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.292663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:40:21.295162 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.295142    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d999d753-9841-4265-b2c5-ce2d4fb17312-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-ln52p\" (UID: \"d999d753-9841-4265-b2c5-ce2d4fb17312\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:40:21.336317 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.336299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss"]
Jul 07 16:40:21.454992 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.454954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dw89d\""
Jul 07 16:40:21.462464 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.462432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"
Jul 07 16:40:21.681254 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.681172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56db5cb645-4dpnk"]
Jul 07 16:40:21.688096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.687190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-ln52p"]
Jul 07 16:40:21.688096 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:21.687704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d11a057_0702_482e_8de5_58ae4048cc56.slice/crio-c8f678e44d0b97680ff1e525602cd415f245d10aa7bacbf81162e7fee7c42087 WatchSource:0}: Error finding container c8f678e44d0b97680ff1e525602cd415f245d10aa7bacbf81162e7fee7c42087: Status 404 returned error can't find the container with id c8f678e44d0b97680ff1e525602cd415f245d10aa7bacbf81162e7fee7c42087
Jul 07 16:40:21.689571 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:21.689544    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd999d753_9841_4265_b2c5_ce2d4fb17312.slice/crio-ca556e497085b590e310b40c380f07030ad679798505d4e8697e87566e52efb1 WatchSource:0}: Error finding container ca556e497085b590e310b40c380f07030ad679798505d4e8697e87566e52efb1: Status 404 returned error can't find the container with id ca556e497085b590e310b40c380f07030ad679798505d4e8697e87566e52efb1
Jul 07 16:40:21.706845 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.706759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88"]
Jul 07 16:40:21.710492 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:21.710453    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae08890_087b_437c_9b80_892f14c498bb.slice/crio-a8ac4ea2d3b36ae59a0d02958c2d24bf5f50b0277f3b3503c964c83a484ba540 WatchSource:0}: Error finding container a8ac4ea2d3b36ae59a0d02958c2d24bf5f50b0277f3b3503c964c83a484ba540: Status 404 returned error can't find the container with id a8ac4ea2d3b36ae59a0d02958c2d24bf5f50b0277f3b3503c964c83a484ba540
Jul 07 16:40:21.853984 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.853913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56db5cb645-4dpnk" event={"ID":"5d11a057-0702-482e-8de5-58ae4048cc56","Type":"ContainerStarted","Data":"ef4240dbbf2052f2702fc1c221541f03e2e09861a1f159aba66659d99f94041c"}
Jul 07 16:40:21.853984 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.853960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56db5cb645-4dpnk" event={"ID":"5d11a057-0702-482e-8de5-58ae4048cc56","Type":"ContainerStarted","Data":"c8f678e44d0b97680ff1e525602cd415f245d10aa7bacbf81162e7fee7c42087"}
Jul 07 16:40:21.855392 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.855336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss" event={"ID":"2ef500d3-34a3-4cc6-a911-0d76e73951ca","Type":"ContainerStarted","Data":"977f540fcaf66f2c5f38cb27123132a80744ad80f0e152308dea35ac4be45921"}
Jul 07 16:40:21.858512 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.858489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" event={"ID":"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5","Type":"ContainerStarted","Data":"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"}
Jul 07 16:40:21.858626 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.858538    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:21.859939 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.859897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p" event={"ID":"d999d753-9841-4265-b2c5-ce2d4fb17312","Type":"ContainerStarted","Data":"ca556e497085b590e310b40c380f07030ad679798505d4e8697e87566e52efb1"}
Jul 07 16:40:21.861308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.861250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrp9n" event={"ID":"deb5fca9-079a-4da2-9ee3-3230e475257a","Type":"ContainerStarted","Data":"199bd623af865d22e455dcada9e9665459c2a9f3b03ec7b86ba8e501cb881e44"}
Jul 07 16:40:21.862793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.862772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88" event={"ID":"9ae08890-087b-437c-9b80-892f14c498bb","Type":"ContainerStarted","Data":"a8ac4ea2d3b36ae59a0d02958c2d24bf5f50b0277f3b3503c964c83a484ba540"}
Jul 07 16:40:21.893398 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.893346    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56db5cb645-4dpnk" podStartSLOduration=32.893302802 podStartE2EDuration="32.893302802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:21.892189609 +0000 UTC m=+68.897755818" watchObservedRunningTime="2026-07-07 16:40:21.893302802 +0000 UTC m=+68.898869009"
Jul 07 16:40:21.917103 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:21.916920    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" podStartSLOduration=68.916898888 podStartE2EDuration="1m8.916898888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:21.916177885 +0000 UTC m=+68.921744144" watchObservedRunningTime="2026-07-07 16:40:21.916898888 +0000 UTC m=+68.922465096"
Jul 07 16:40:22.201854 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.201787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:22.283840 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.283744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:22.297308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.297280    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:22.316735 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.316605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:22.413454 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.413420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:22.517473 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.517369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:22.611115 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.610947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:22.872844 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.872621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrp9n" event={"ID":"deb5fca9-079a-4da2-9ee3-3230e475257a","Type":"ContainerStarted","Data":"98d629332f47cd97ee6a51bd39fc5e1b4cae3114d338fd6fea8bfbac9d8427f3"}
Jul 07 16:40:22.873663 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.873399    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:22.874905 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.874870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56db5cb645-4dpnk"
Jul 07 16:40:22.893128 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.893069    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wrp9n" podStartSLOduration=68.008897495 podStartE2EDuration="1m9.893050347s" totalImagesPullingTime="1.884152852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:22.891880602 +0000 UTC m=+69.897446831" watchObservedRunningTime="2026-07-07 16:40:22.893050347 +0000 UTC m=+69.898616546"
Jul 07 16:40:22.935966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:22.935912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:23.017772 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:23.017607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:23.148197 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:23.148044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:23.535575 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:23.535486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:23.604159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:23.604121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:24.389348 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:24.389306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:24.754581 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:24.754494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:24.866072 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:24.866032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:26.151443 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.151410    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:40:26.183600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.183570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:40:26.183754 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.183648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.187477 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.187444    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 16:40:26.187600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.187579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 16:40:26.188942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.188921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 16:40:26.189172 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.189156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vxgkb\""
Jul 07 16:40:26.189845 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.189797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 16:40:26.189931 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.189889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 16:40:26.190191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.190170    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 16:40:26.190249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.190216    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 16:40:26.339728 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.339728 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.339979 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.339979 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m994\" (UniqueName: \"kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.339979 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.340094 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.339994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441237 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441237 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m994\" (UniqueName: \"kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.441549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.441487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.442135 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.442111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.442250 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.442165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.442250 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.442239    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.444024 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.444003    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.444177 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.444157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.453286 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.453259    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m994\" (UniqueName: \"kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994\") pod \"console-85f84c6dfc-xnqpr\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") " pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.498740 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.498708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:26.690923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.690888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:26.790831 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:26.790727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:27.421066 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.421038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:40:27.424709 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:27.424675    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20995a66_7717_4a8f_8ebb_654f978c09c6.slice/crio-759396aa3727f2b0260f36a3da3b2df3697337f07ea22f89170588f26cee42b4 WatchSource:0}: Error finding container 759396aa3727f2b0260f36a3da3b2df3697337f07ea22f89170588f26cee42b4: Status 404 returned error can't find the container with id 759396aa3727f2b0260f36a3da3b2df3697337f07ea22f89170588f26cee42b4
Jul 07 16:40:27.785499 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.785462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:27.882480 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.882448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:27.893335 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.893298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss" event={"ID":"2ef500d3-34a3-4cc6-a911-0d76e73951ca","Type":"ContainerStarted","Data":"9a514f4a77962d096ed0c127ac10c88a07be7089950c843f376cb0208d28750c"}
Jul 07 16:40:27.893501 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.893356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss" event={"ID":"2ef500d3-34a3-4cc6-a911-0d76e73951ca","Type":"ContainerStarted","Data":"207b04040c7575eb02eb7dad8eb5461cbfeb0c05e4fe76251df0e511354f5c7b"}
Jul 07 16:40:27.894743 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.894718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f84c6dfc-xnqpr" event={"ID":"20995a66-7717-4a8f-8ebb-654f978c09c6","Type":"ContainerStarted","Data":"759396aa3727f2b0260f36a3da3b2df3697337f07ea22f89170588f26cee42b4"}
Jul 07 16:40:27.896560 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.896535    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwq82" event={"ID":"e9f7011b-561c-438e-83f6-d9a9c076a92a","Type":"ContainerStarted","Data":"46759296990f12db1d8644c6e90b6b6726ab229f041d824a1f2fad082022fba5"}
Jul 07 16:40:27.896656 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.896584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwq82" event={"ID":"e9f7011b-561c-438e-83f6-d9a9c076a92a","Type":"ContainerStarted","Data":"deefeaff224a820157438a0d850f06b3281af3b7da4d2b0d54088809d6b8c1c8"}
Jul 07 16:40:27.896656 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.896606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:27.898299 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.898263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p" event={"ID":"d999d753-9841-4265-b2c5-ce2d4fb17312","Type":"ContainerStarted","Data":"3cc5832e1478bb23cf5b8b46cb2b4a2d0a6499f197359c41b8b898ca8c1ba5b4"}
Jul 07 16:40:27.900189 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.900162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mn7vv" event={"ID":"f4214a03-83cb-49df-889b-0e098d963c07","Type":"ContainerStarted","Data":"aaac610fd06b568b5cb364028fb80d207b1b6cc53d37d72e9c3df25976fc0669"}
Jul 07 16:40:27.901724 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.901707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88" event={"ID":"9ae08890-087b-437c-9b80-892f14c498bb","Type":"ContainerStarted","Data":"d1d7dceebd0241ee1af8112ffa250d71fb8d7a5b66edd84de94b18aff659c87e"}
Jul 07 16:40:27.917219 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.917179    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fkzss" podStartSLOduration=33.195593287 podStartE2EDuration="38.917166328s" totalImagesPullingTime="5.721573041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:27.915426377 +0000 UTC m=+74.920992603" watchObservedRunningTime="2026-07-07 16:40:27.917166328 +0000 UTC m=+74.922732559"
Jul 07 16:40:27.931859 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.931796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mn7vv" podStartSLOduration=67.205636636 podStartE2EDuration="1m14.931779552s" totalImagesPullingTime="7.726142916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:27.930876167 +0000 UTC m=+74.936442376" watchObservedRunningTime="2026-07-07 16:40:27.931779552 +0000 UTC m=+74.937345761"
Jul 07 16:40:27.954514 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.954467    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-ln52p" podStartSLOduration=33.369392089 podStartE2EDuration="38.954454879s" totalImagesPullingTime="5.58506279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:27.952463773 +0000 UTC m=+74.958029981" watchObservedRunningTime="2026-07-07 16:40:27.954454879 +0000 UTC m=+74.960021148"
Jul 07 16:40:27.982843 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:27.982786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:28.002627 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.002572    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jwq82" podStartSLOduration=33.467877197 podStartE2EDuration="40.00255177s" totalImagesPullingTime="6.534674573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:27.999258576 +0000 UTC m=+75.004824785" watchObservedRunningTime="2026-07-07 16:40:28.00255177 +0000 UTC m=+75.008118010"
Jul 07 16:40:28.040123 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.040063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pqw88" podStartSLOduration=33.476320396 podStartE2EDuration="39.040045211s" totalImagesPullingTime="5.563724815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:28.039653028 +0000 UTC m=+75.045219237" watchObservedRunningTime="2026-07-07 16:40:28.040045211 +0000 UTC m=+75.045611418"
Jul 07 16:40:28.117356 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.117306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:28.219341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.219223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:28.330116 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.330080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:28.407368 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:28.407334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:29.724565 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:29.724530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:29.819324 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:29.819286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:30.751768 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:30.751729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:30.805585 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:30.805541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:30.916262 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:30.916229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f84c6dfc-xnqpr" event={"ID":"20995a66-7717-4a8f-8ebb-654f978c09c6","Type":"ContainerStarted","Data":"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"}
Jul 07 16:40:30.936288 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:30.936237    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f84c6dfc-xnqpr" podStartSLOduration=1.766699865 podStartE2EDuration="4.936210548s" totalImagesPullingTime="3.169510683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:30.936188591 +0000 UTC m=+77.941754835" watchObservedRunningTime="2026-07-07 16:40:30.936210548 +0000 UTC m=+77.941776758"
Jul 07 16:40:30.969930 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:30.969899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.043754 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.043718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.083885 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.083849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:31.086233 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.086210    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eef9ecfc-9e21-49c7-bb62-da0b71e20ffe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg78s\" (UID: \"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe\") " pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:31.256250 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.256156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.341675 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.341649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-46nj6\""
Jul 07 16:40:31.349540 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.349518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zg78s"
Jul 07 16:40:31.421886 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.421853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.496617 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.496598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zg78s"]
Jul 07 16:40:31.498291 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:31.498263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef9ecfc_9e21_49c7_bb62_da0b71e20ffe.slice/crio-0804defe842c8183025991f52bbd98c24fdddc3ba0548c12e957b1e68285f3e5 WatchSource:0}: Error finding container 0804defe842c8183025991f52bbd98c24fdddc3ba0548c12e957b1e68285f3e5: Status 404 returned error can't find the container with id 0804defe842c8183025991f52bbd98c24fdddc3ba0548c12e957b1e68285f3e5
Jul 07 16:40:31.528960 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.528874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.592602 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.592575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.768527 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.768486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.833697 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.833590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:31.922282 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:31.922251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg78s" event={"ID":"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe","Type":"ContainerStarted","Data":"0804defe842c8183025991f52bbd98c24fdddc3ba0548c12e957b1e68285f3e5"}
Jul 07 16:40:33.309245 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:33.309210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:33.410634 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:33.410597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:33.804940 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:33.804900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:33.905948 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:33.905898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:35.131542 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:35.131501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:35.233966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:35.233805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:35.940209 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:35.940172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg78s" event={"ID":"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe","Type":"ContainerStarted","Data":"27bf57dfc775b1b37ee739171015cdcbefc04d842947d82975378a505d2bb485"}
Jul 07 16:40:36.498832 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:36.498774    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:36.499226 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:36.498862    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:36.503759 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:36.503736    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:36.947050 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:36.947000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg78s" event={"ID":"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe","Type":"ContainerStarted","Data":"78f7b802874f4808bb04165f6139d60b64c84d6c8dc9d358669c208ea4f2d8f9"}
Jul 07 16:40:36.952579 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:36.952553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:40:37.090456 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:37.090417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:37.190690 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:37.190652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:37.583785 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:37.583744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:37.683871 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:37.683839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:37.909244 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:37.909211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jwq82"
Jul 07 16:40:38.956781 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:38.956701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg78s" event={"ID":"eef9ecfc-9e21-49c7-bb62-da0b71e20ffe","Type":"ContainerStarted","Data":"92bb6e90d23f28927e8143f0b337403555f91791f2a45137f9e3a1a04fc09727"}
Jul 07 16:40:39.834177 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:39.834140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:39.893776 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:39.893735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:42.878055 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:42.878028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:40:42.902572 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:42.902520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zg78s" podStartSLOduration=36.842941367 podStartE2EDuration="43.902499092s" totalImagesPullingTime="7.059557725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:38.98543979 +0000 UTC m=+85.991006022" watchObservedRunningTime="2026-07-07 16:40:42.902499092 +0000 UTC m=+89.908065300"
Jul 07 16:40:43.044911 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:43.044880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:43.150509 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:43.150418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:44.376198 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:44.376167    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:40:44.461206 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:44.461170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:44.534976 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:44.534942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:45.036641 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:45.036608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:45.095384 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:45.095347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.112718 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.112680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.312726 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.312689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.360673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.360639    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jr2zt"]
Jul 07 16:40:46.365013 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.364953    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"]
Jul 07 16:40:46.365145 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.365041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.367923 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.367902    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-njbxr\""
Jul 07 16:40:46.368332 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.368316    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.369166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.369148    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 16:40:46.369166 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.369157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 16:40:46.369296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.369148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 16:40:46.369296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.369179    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 16:40:46.370896 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.370876    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-68rd4\""
Jul 07 16:40:46.370896 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.370888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 16:40:46.371033 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.370972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 16:40:46.371212 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.371197    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 16:40:46.388398 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.388374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"]
Jul 07 16:40:46.412140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.412100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.511710 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.511672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.512704 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-sys\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.512825 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6t89\" (UniqueName: \"kubernetes.io/projected/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-api-access-m6t89\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.512825 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.512928 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.512928 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.512928 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-textfile\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.513035 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.513035 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.512994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-root\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.513035 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8r2h\" (UniqueName: \"kubernetes.io/projected/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-kube-api-access-f8r2h\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.513035 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-wtmp\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.513208 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.513208 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.513208 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.513208 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3728832e-a46f-4cd7-9fd3-17fc136d8922-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.513208 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.513164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-metrics-client-ca\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613608 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-wtmp\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613608 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3728832e-a46f-4cd7-9fd3-17fc136d8922-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-metrics-client-ca\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-sys\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613758    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-wtmp\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6t89\" (UniqueName: \"kubernetes.io/projected/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-api-access-m6t89\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.613867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-textfile\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-root\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614111    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3728832e-a46f-4cd7-9fd3-17fc136d8922-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8r2h\" (UniqueName: \"kubernetes.io/projected/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-kube-api-access-f8r2h\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.613984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.614247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-sys\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614650 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:46.614294    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 16:40:46.614650 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:46.614353    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls podName:3728832e-a46f-4cd7-9fd3-17fc136d8922 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:47.114335994 +0000 UTC m=+94.119902185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-2769n" (UID: "3728832e-a46f-4cd7-9fd3-17fc136d8922") : secret "kube-state-metrics-tls" not found
Jul 07 16:40:46.614650 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-root\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614650 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614485    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.614650 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-metrics-client-ca\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614926 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614680    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614926 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614688    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-textfile\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.614926 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:46.614845    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 16:40:46.614926 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:46.614911    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls podName:0cc16650-77d5-44c1-92f5-5841f8a6b3cf nodeName:}" failed. No retries permitted until 2026-07-07 16:40:47.114896151 +0000 UTC m=+94.120462337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls") pod "node-exporter-jr2zt" (UID: "0cc16650-77d5-44c1-92f5-5841f8a6b3cf") : secret "node-exporter-tls" not found
Jul 07 16:40:46.615091 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.614986    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.616204 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.616183    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.616673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.616655    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.625972 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.625942    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8r2h\" (UniqueName: \"kubernetes.io/projected/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-kube-api-access-f8r2h\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:46.626807 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.626784    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6t89\" (UniqueName: \"kubernetes.io/projected/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-api-access-m6t89\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:46.711483 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.711446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:46.814139 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:46.814102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.052864 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.052829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.117968 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.117936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:47.118341 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.117990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:47.118341 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:47.118099    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 16:40:47.118341 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:40:47.118159    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls podName:0cc16650-77d5-44c1-92f5-5841f8a6b3cf nodeName:}" failed. No retries permitted until 2026-07-07 16:40:48.118143977 +0000 UTC m=+95.123710171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls") pod "node-exporter-jr2zt" (UID: "0cc16650-77d5-44c1-92f5-5841f8a6b3cf") : secret "node-exporter-tls" not found
Jul 07 16:40:47.120369 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.120347    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3728832e-a46f-4cd7-9fd3-17fc136d8922-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-2769n\" (UID: \"3728832e-a46f-4cd7-9fd3-17fc136d8922\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:47.281089 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.281056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"
Jul 07 16:40:47.328675 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.328592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.422559 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.422491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n"]
Jul 07 16:40:47.424544 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:47.424521    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3728832e_a46f_4cd7_9fd3_17fc136d8922.slice/crio-351b8c3c29e710f0efd475b025996ad6e9e61f9adedf5645155d0d785369ebbf WatchSource:0}: Error finding container 351b8c3c29e710f0efd475b025996ad6e9e61f9adedf5645155d0d785369ebbf: Status 404 returned error can't find the container with id 351b8c3c29e710f0efd475b025996ad6e9e61f9adedf5645155d0d785369ebbf
Jul 07 16:40:47.434914 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.434888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.522282 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.522243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.664260 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.664228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.822595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.822556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:47.989230 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:47.989151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n" event={"ID":"3728832e-a46f-4cd7-9fd3-17fc136d8922","Type":"ContainerStarted","Data":"351b8c3c29e710f0efd475b025996ad6e9e61f9adedf5645155d0d785369ebbf"}
Jul 07 16:40:48.128303 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.127867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:48.131292 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.131257    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cc16650-77d5-44c1-92f5-5841f8a6b3cf-node-exporter-tls\") pod \"node-exporter-jr2zt\" (UID: \"0cc16650-77d5-44c1-92f5-5841f8a6b3cf\") " pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:48.176276 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.176243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jr2zt"
Jul 07 16:40:48.189689 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:48.189652    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc16650_77d5_44c1_92f5_5841f8a6b3cf.slice/crio-58c0ec7dadc22823b5ed5626935b386a961d7d279a40bd6f7e1d60b635d1186b WatchSource:0}: Error finding container 58c0ec7dadc22823b5ed5626935b386a961d7d279a40bd6f7e1d60b635d1186b: Status 404 returned error can't find the container with id 58c0ec7dadc22823b5ed5626935b386a961d7d279a40bd6f7e1d60b635d1186b
Jul 07 16:40:48.333520 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.333436    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d566f96dc-pk7j5"]
Jul 07 16:40:48.338440 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.338417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341537    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a5buq26fmir15\""
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341600    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kdhs8\""
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 16:40:48.341711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 16:40:48.342101 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.341918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 16:40:48.350259 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.350237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d566f96dc-pk7j5"]
Jul 07 16:40:48.430411 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0382c-0b36-44e1-bc5a-4c17513c6690-metrics-client-ca\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430590 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430755 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljxlp\" (UniqueName: \"kubernetes.io/projected/96c0382c-0b36-44e1-bc5a-4c17513c6690-kube-api-access-ljxlp\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430755 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430755 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-grpc-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.430755 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.430703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531741 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0382c-0b36-44e1-bc5a-4c17513c6690-metrics-client-ca\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljxlp\" (UniqueName: \"kubernetes.io/projected/96c0382c-0b36-44e1-bc5a-4c17513c6690-kube-api-access-ljxlp\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-grpc-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.531942 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.532206 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.531965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.532206 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.532013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.532586 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.532547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0382c-0b36-44e1-bc5a-4c17513c6690-metrics-client-ca\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.534956 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.534922    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.535764 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.535719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.535987 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.535936    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.536102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.536064    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.536168 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.536148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.536168 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.536161    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96c0382c-0b36-44e1-bc5a-4c17513c6690-secret-grpc-tls\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.543977 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.543956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljxlp\" (UniqueName: \"kubernetes.io/projected/96c0382c-0b36-44e1-bc5a-4c17513c6690-kube-api-access-ljxlp\") pod \"thanos-querier-d566f96dc-pk7j5\" (UID: \"96c0382c-0b36-44e1-bc5a-4c17513c6690\") " pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.650157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.650125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:48.827666 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.827562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d566f96dc-pk7j5"]
Jul 07 16:40:48.830428 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:48.830372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c0382c_0b36_44e1_bc5a_4c17513c6690.slice/crio-81c963c47ba34ffc2787837135cdbde167b7c088b31318b3edabd63dc5debebe WatchSource:0}: Error finding container 81c963c47ba34ffc2787837135cdbde167b7c088b31318b3edabd63dc5debebe: Status 404 returned error can't find the container with id 81c963c47ba34ffc2787837135cdbde167b7c088b31318b3edabd63dc5debebe
Jul 07 16:40:48.995082 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.995052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n" event={"ID":"3728832e-a46f-4cd7-9fd3-17fc136d8922","Type":"ContainerStarted","Data":"fe6a270325563e67cbf11e3624bfb7a14cf9d5b2467cf8a948ef4068a616de95"}
Jul 07 16:40:48.995246 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.995107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n" event={"ID":"3728832e-a46f-4cd7-9fd3-17fc136d8922","Type":"ContainerStarted","Data":"8c145fea8a070240e7d85c69e064be58e3230fa14b0d1a8c76b4a800e6573c64"}
Jul 07 16:40:48.995246 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.995127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n" event={"ID":"3728832e-a46f-4cd7-9fd3-17fc136d8922","Type":"ContainerStarted","Data":"936a8600282585295544c96bc6a2613f6425d367932ef13847356a5a3838fd9a"}
Jul 07 16:40:48.997090 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.997060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"81c963c47ba34ffc2787837135cdbde167b7c088b31318b3edabd63dc5debebe"}
Jul 07 16:40:48.998673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:48.998640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jr2zt" event={"ID":"0cc16650-77d5-44c1-92f5-5841f8a6b3cf","Type":"ContainerStarted","Data":"58c0ec7dadc22823b5ed5626935b386a961d7d279a40bd6f7e1d60b635d1186b"}
Jul 07 16:40:49.016673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:49.016632    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-2769n" podStartSLOduration=1.709367544 podStartE2EDuration="3.016617561s" totalImagesPullingTime="1.307250017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:49.016282878 +0000 UTC m=+96.021849086" watchObservedRunningTime="2026-07-07 16:40:49.016617561 +0000 UTC m=+96.022183768"
Jul 07 16:40:49.311985 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:49.311888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:49.413346 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:49.413320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:49.517796 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:49.517754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:49.778212 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:49.778179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:50.004409 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:50.004374    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cc16650-77d5-44c1-92f5-5841f8a6b3cf" containerID="4b04003817cb9a21d525191118b84a635292eb3dca2b247259cdf88e5e37ea73" exitCode=0
Jul 07 16:40:50.004579 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:50.004461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jr2zt" event={"ID":"0cc16650-77d5-44c1-92f5-5841f8a6b3cf","Type":"ContainerDied","Data":"4b04003817cb9a21d525191118b84a635292eb3dca2b247259cdf88e5e37ea73"}
Jul 07 16:40:50.847846 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:50.847794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-22ddz"
Jul 07 16:40:51.013020 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.012990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jr2zt" event={"ID":"0cc16650-77d5-44c1-92f5-5841f8a6b3cf","Type":"ContainerStarted","Data":"ec66e97646bbfe0347a8df420219179846d9758f2dd98b505672e7285612ca13"}
Jul 07 16:40:51.013107 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.013047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jr2zt" event={"ID":"0cc16650-77d5-44c1-92f5-5841f8a6b3cf","Type":"ContainerStarted","Data":"361a8f65a0b166a0097bac072a0f4b7f5cabe805d5aa771f1ee9091b7b894c23"}
Jul 07 16:40:51.038829 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.038731    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jr2zt" podStartSLOduration=3.748733972 podStartE2EDuration="5.038709801s" totalImagesPullingTime="1.216065221s" totalInitContainerRuntime="73.910608ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:51.038146218 +0000 UTC m=+98.043712428" watchObservedRunningTime="2026-07-07 16:40:51.038709801 +0000 UTC m=+98.044276013"
Jul 07 16:40:51.159162 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.159137    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"]
Jul 07 16:40:51.162248 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.162119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:51.163499 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.163479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.166279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.166260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 16:40:51.166497 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.166322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-w75m7\""
Jul 07 16:40:51.179459 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.176236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"]
Jul 07 16:40:51.248723 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.248684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:51.257563 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.257542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.257664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.257584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lg75\" (UniqueName: \"kubernetes.io/projected/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-kube-api-access-7lg75\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.358273 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.358196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.358273 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.358238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lg75\" (UniqueName: \"kubernetes.io/projected/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-kube-api-access-7lg75\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.360750 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.360717    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.367727 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.367695    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lg75\" (UniqueName: \"kubernetes.io/projected/ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff-kube-api-access-7lg75\") pod \"monitoring-plugin-d5dcff7cf-kw2qq\" (UID: \"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.400701 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.400673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:51.475699 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.475667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:51.614221 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:51.614194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"]
Jul 07 16:40:51.615961 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:51.615933    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9cf030_4c1d_4fea_94ad_4fb7c36a56ff.slice/crio-cb5de40d0302b2d0dfcab441a95405b9c54917399373f1cc07bc6b5b44de4f79 WatchSource:0}: Error finding container cb5de40d0302b2d0dfcab441a95405b9c54917399373f1cc07bc6b5b44de4f79: Status 404 returned error can't find the container with id cb5de40d0302b2d0dfcab441a95405b9c54917399373f1cc07bc6b5b44de4f79
Jul 07 16:40:52.018453 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.018421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq" event={"ID":"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff","Type":"ContainerStarted","Data":"cb5de40d0302b2d0dfcab441a95405b9c54917399373f1cc07bc6b5b44de4f79"}
Jul 07 16:40:52.020594 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.020570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"7aca02f8e035d063d5950cd0a7117c8cb7eadaef4b582ace4eb5f47198dca26d"}
Jul 07 16:40:52.020698 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.020628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"360190fc3440f47cd4f0835df5cc57777e265527d5c64e0c48a079412a24ce3f"}
Jul 07 16:40:52.020698 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.020654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"4f1631254811f5baedb56f47450f20f707e5567b793738769d87e0ac9e9b6716"}
Jul 07 16:40:52.127593 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.127549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:52.184588 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.184547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:52.670760 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:52.670729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:53.028604 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:53.028510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"ddb085d0088302d27f8ddbdc3c26ab3461466a42a36f0574f78356943b04e2e6"}
Jul 07 16:40:53.029083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:53.028603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"9c9186aa468586b5fa795a518a2b985d1253cda53f87aac4706b8de2530d8b7b"}
Jul 07 16:40:53.029083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:53.028658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" event={"ID":"96c0382c-0b36-44e1-bc5a-4c17513c6690","Type":"ContainerStarted","Data":"7998639174b1b3bb39ce55f7508b706c14a60e46c8ac03a400417999c226a88a"}
Jul 07 16:40:53.029083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:53.028702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:40:53.055289 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:53.055225    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5" podStartSLOduration=1.841084876 podStartE2EDuration="5.055207656s" totalImagesPullingTime="3.21412278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:53.054232977 +0000 UTC m=+100.059799244" watchObservedRunningTime="2026-07-07 16:40:53.055207656 +0000 UTC m=+100.060773863"
Jul 07 16:40:54.034185 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.034144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq" event={"ID":"ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff","Type":"ContainerStarted","Data":"ff704e09d6d3abfd60fe373a88c8732f6d1691a84e6444c13c31dc2a7daf3d4e"}
Jul 07 16:40:54.034586 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.034419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:54.039741 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.039718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq"
Jul 07 16:40:54.052918 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.052879    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kw2qq" podStartSLOduration=1.448649927 podStartE2EDuration="3.052865278s" totalImagesPullingTime="1.604215351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:54.05139634 +0000 UTC m=+101.056962549" watchObservedRunningTime="2026-07-07 16:40:54.052865278 +0000 UTC m=+101.058431485"
Jul 07 16:40:54.758848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.758792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:54.859177 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:54.859146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:56.339851 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.339788    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:40:56.387870 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.387836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:40:56.388020 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.387945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.397002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.396982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 16:40:56.505439 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505439 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.505638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.505611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srvv\" (UniqueName: \"kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606574 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srvv\" (UniqueName: \"kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606574 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606574 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606847 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606847 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606847 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.606847 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.606711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.607403 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.607353    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.607542 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.607411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.607583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.607538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.607693 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.607670    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.609141 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.609120    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.609301 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.609285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.615950 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.615922    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srvv\" (UniqueName: \"kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv\") pod \"console-7bd8476d7c-kwqvj\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") " pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.689954 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.689915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:56.697739 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.697717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:40:56.790462 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.790424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:56.847123 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:56.847102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:40:56.849267 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:40:56.849234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d391e5_47af_4a75_aaae_3891aaffcf5a.slice/crio-fedeb06a93b2ab6d6d4150ca27a0b53e7c03de0ead7fe424a5d0733010138da6 WatchSource:0}: Error finding container fedeb06a93b2ab6d6d4150ca27a0b53e7c03de0ead7fe424a5d0733010138da6: Status 404 returned error can't find the container with id fedeb06a93b2ab6d6d4150ca27a0b53e7c03de0ead7fe424a5d0733010138da6
Jul 07 16:40:57.047873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:57.047841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd8476d7c-kwqvj" event={"ID":"c1d391e5-47af-4a75-aaae-3891aaffcf5a","Type":"ContainerStarted","Data":"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"}
Jul 07 16:40:57.048045 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:57.047896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd8476d7c-kwqvj" event={"ID":"c1d391e5-47af-4a75-aaae-3891aaffcf5a","Type":"ContainerStarted","Data":"fedeb06a93b2ab6d6d4150ca27a0b53e7c03de0ead7fe424a5d0733010138da6"}
Jul 07 16:40:57.073598 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:57.073517    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd8476d7c-kwqvj" podStartSLOduration=1.073502869 podStartE2EDuration="1.073502869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:57.072936099 +0000 UTC m=+104.078502321" watchObservedRunningTime="2026-07-07 16:40:57.073502869 +0000 UTC m=+104.079069101"
Jul 07 16:40:57.294058 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:57.293974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:40:59.041787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:40:59.041757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d566f96dc-pk7j5"
Jul 07 16:41:06.698391 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:06.698340    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:41:06.699024 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:06.698417    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:41:06.703245 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:06.703221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:41:07.094361 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:07.094269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:41:07.142431 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:07.142398    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:41:07.243680 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:07.243650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:07.299606 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:07.299562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:07.356703 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:07.356611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:09.098304 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.098272    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d9e7270-6ec5-48bc-8b20-ea9e38d32a75" containerID="59c0003fa0e4b61e9996d80b1a9fde9913e3b65cffd5432b142f9c9eb300b4bb" exitCode=0
Jul 07 16:41:09.098679 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.098321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf" event={"ID":"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75","Type":"ContainerDied","Data":"59c0003fa0e4b61e9996d80b1a9fde9913e3b65cffd5432b142f9c9eb300b4bb"}
Jul 07 16:41:09.098679 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.098641    2565 scope.go:117] "RemoveContainer" containerID="59c0003fa0e4b61e9996d80b1a9fde9913e3b65cffd5432b142f9c9eb300b4bb"
Jul 07 16:41:09.396821 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.396757    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" podUID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" containerName="registry" containerID="cri-o://fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5" gracePeriod=30
Jul 07 16:41:09.691640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.691612    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:41:09.753023 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.752990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:09.819790 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.819763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.819987 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.819840    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820054 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820107 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99dhf\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820154 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820137    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820216 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820216 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820316 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets\") pod \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\" (UID: \"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5\") "
Jul 07 16:41:09.820572 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820545    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:41:09.820660 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.820591    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:41:09.822675 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.822650    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:41:09.822917 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.822891    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:41:09.823037 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.823001    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:41:09.823221 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.823192    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf" (OuterVolumeSpecName: "kube-api-access-99dhf") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "kube-api-access-99dhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:41:09.823303 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.823254    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:41:09.828445 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.828423    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" (UID: "6882cd3f-8b7a-458c-81b7-8a94de5dd0d5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:41:09.854300 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.854259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:09.921436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921362    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-trusted-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921390    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-image-registry-private-configuration\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921403    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-certificates\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921416    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-installation-pull-secrets\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921428    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921678 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921441    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-ca-trust-extracted\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921678 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921455    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-bound-sa-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:09.921678 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:09.921466    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dhf\" (UniqueName: \"kubernetes.io/projected/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5-kube-api-access-99dhf\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:10.108157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.108123    2565 generic.go:356] "Generic (PLEG): container finished" podID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" containerID="fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5" exitCode=0
Jul 07 16:41:10.108663 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.108179    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx"
Jul 07 16:41:10.108663 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.108203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" event={"ID":"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5","Type":"ContainerDied","Data":"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"}
Jul 07 16:41:10.108663 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.108303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c8bcb6b-cmkjx" event={"ID":"6882cd3f-8b7a-458c-81b7-8a94de5dd0d5","Type":"ContainerDied","Data":"22ee2a9eb736a0b6d813ce8cf4e05cc1f475af10a4cc0480f8dfa993feaf1686"}
Jul 07 16:41:10.108663 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.108321    2565 scope.go:117] "RemoveContainer" containerID="fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"
Jul 07 16:41:10.110165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.110143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s8mkf" event={"ID":"4d9e7270-6ec5-48bc-8b20-ea9e38d32a75","Type":"ContainerStarted","Data":"3877d9255fcc9db981c0f252eebeda8b1508f2ebfbcf6dd6cd474d3741c95769"}
Jul 07 16:41:10.116971 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.116955    2565 scope.go:117] "RemoveContainer" containerID="fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"
Jul 07 16:41:10.117208 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:41:10.117191    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5\": container with ID starting with fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5 not found: ID does not exist" containerID="fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"
Jul 07 16:41:10.117252 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.117216    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5"} err="failed to get container status \"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5\": rpc error: code = NotFound desc = could not find container \"fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5\": container with ID starting with fda1a955255ee42648f92bd9017dcb95a7476224df22772f512c90174c01fee5 not found: ID does not exist"
Jul 07 16:41:10.156334 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.156285    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:41:10.164876 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:10.164846    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58c8bcb6b-cmkjx"]
Jul 07 16:41:11.496783 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:11.496747    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" path="/var/lib/kubelet/pods/6882cd3f-8b7a-458c-81b7-8a94de5dd0d5/volumes"
Jul 07 16:41:13.123760 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:13.123727    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e016fb5-877d-4765-b8ef-304ff7fc130d" containerID="1f36aaf1720b7c4faa9fd240d3079237ed4eef2d08b477667ce2911ff7927992" exitCode=0
Jul 07 16:41:13.124119 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:13.123797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp" event={"ID":"0e016fb5-877d-4765-b8ef-304ff7fc130d","Type":"ContainerDied","Data":"1f36aaf1720b7c4faa9fd240d3079237ed4eef2d08b477667ce2911ff7927992"}
Jul 07 16:41:13.124161 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:13.124120    2565 scope.go:117] "RemoveContainer" containerID="1f36aaf1720b7c4faa9fd240d3079237ed4eef2d08b477667ce2911ff7927992"
Jul 07 16:41:14.129078 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:14.129047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5fskp" event={"ID":"0e016fb5-877d-4765-b8ef-304ff7fc130d","Type":"ContainerStarted","Data":"5e60aacf3849e5cd3fbdd1627b5b0e41fb375e0041f2beb94e6d0aaeb6a94735"}
Jul 07 16:41:19.149722 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:19.149690    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6f211a4-adcc-4101-8ede-164e5ffe1995" containerID="0d89a4e352de88df3abff78624428f991972f03c3a197e0c6a6df585e3146920" exitCode=0
Jul 07 16:41:19.150117 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:19.149763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8" event={"ID":"b6f211a4-adcc-4101-8ede-164e5ffe1995","Type":"ContainerDied","Data":"0d89a4e352de88df3abff78624428f991972f03c3a197e0c6a6df585e3146920"}
Jul 07 16:41:19.150117 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:19.150105    2565 scope.go:117] "RemoveContainer" containerID="0d89a4e352de88df3abff78624428f991972f03c3a197e0c6a6df585e3146920"
Jul 07 16:41:20.156372 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:20.156337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8kwr8" event={"ID":"b6f211a4-adcc-4101-8ede-164e5ffe1995","Type":"ContainerStarted","Data":"2931dce16b6c09faf3bbd9105681ffdd819588cac8deb53165b4de1c883111b8"}
Jul 07 16:41:32.164879 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.164835    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85f84c6dfc-xnqpr" podUID="20995a66-7717-4a8f-8ebb-654f978c09c6" containerName="console" containerID="cri-o://136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde" gracePeriod=15
Jul 07 16:41:32.414789 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.414763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:41:32.418726 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418685    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m994\" (UniqueName: \"kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.418726 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.418848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418753    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.418848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.418848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418836    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.418970 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.418924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert\") pod \"20995a66-7717-4a8f-8ebb-654f978c09c6\" (UID: \"20995a66-7717-4a8f-8ebb-654f978c09c6\") "
Jul 07 16:41:32.419204 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.419178    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:41:32.419369 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.419184    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config" (OuterVolumeSpecName: "console-config") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:41:32.419369 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.419238    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:41:32.421085 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.421054    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994" (OuterVolumeSpecName: "kube-api-access-5m994") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "kube-api-access-5m994". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:41:32.421170 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.421115    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:41:32.421209 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.421167    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "20995a66-7717-4a8f-8ebb-654f978c09c6" (UID: "20995a66-7717-4a8f-8ebb-654f978c09c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:41:32.520169 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520131    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:32.520169 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520163    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:32.520169 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520172    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20995a66-7717-4a8f-8ebb-654f978c09c6-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:32.520400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520182    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:32.520400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520191    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m994\" (UniqueName: \"kubernetes.io/projected/20995a66-7717-4a8f-8ebb-654f978c09c6-kube-api-access-5m994\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:32.520400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:32.520200    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20995a66-7717-4a8f-8ebb-654f978c09c6-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:41:33.207178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.207142    2565 generic.go:356] "Generic (PLEG): container finished" podID="20995a66-7717-4a8f-8ebb-654f978c09c6" containerID="136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde" exitCode=0
Jul 07 16:41:33.207595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.207193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f84c6dfc-xnqpr"
Jul 07 16:41:33.207595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.207221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f84c6dfc-xnqpr" event={"ID":"20995a66-7717-4a8f-8ebb-654f978c09c6","Type":"ContainerDied","Data":"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"}
Jul 07 16:41:33.207595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.207277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f84c6dfc-xnqpr" event={"ID":"20995a66-7717-4a8f-8ebb-654f978c09c6","Type":"ContainerDied","Data":"759396aa3727f2b0260f36a3da3b2df3697337f07ea22f89170588f26cee42b4"}
Jul 07 16:41:33.207595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.207300    2565 scope.go:117] "RemoveContainer" containerID="136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"
Jul 07 16:41:33.216088 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.216072    2565 scope.go:117] "RemoveContainer" containerID="136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"
Jul 07 16:41:33.216340 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:41:33.216321    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde\": container with ID starting with 136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde not found: ID does not exist" containerID="136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"
Jul 07 16:41:33.216387 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.216349    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde"} err="failed to get container status \"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde\": rpc error: code = NotFound desc = could not find container \"136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde\": container with ID starting with 136ed3606706b582e4221a2b701dd052dc9c2de2e8dcd6a0d0e878cded6efbde not found: ID does not exist"
Jul 07 16:41:33.230472 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.230441    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:41:33.234703 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.234683    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f84c6dfc-xnqpr"]
Jul 07 16:41:33.496651 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:41:33.496574    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20995a66-7717-4a8f-8ebb-654f978c09c6" path="/var/lib/kubelet/pods/20995a66-7717-4a8f-8ebb-654f978c09c6/volumes"
Jul 07 16:42:02.478220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:02.478176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:02.573325 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:02.573292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:09.023679 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.023594    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:42:09.024140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024066    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" containerName="registry"
Jul 07 16:42:09.024140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024085    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" containerName="registry"
Jul 07 16:42:09.024140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024101    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20995a66-7717-4a8f-8ebb-654f978c09c6" containerName="console"
Jul 07 16:42:09.024140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024110    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20995a66-7717-4a8f-8ebb-654f978c09c6" containerName="console"
Jul 07 16:42:09.024340 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024211    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6882cd3f-8b7a-458c-81b7-8a94de5dd0d5" containerName="registry"
Jul 07 16:42:09.024340 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.024225    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="20995a66-7717-4a8f-8ebb-654f978c09c6" containerName="console"
Jul 07 16:42:09.027426 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.027401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.040788 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.040762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:42:09.087907 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.087862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:09.130584 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130747 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130747 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130747 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cdrz\" (UniqueName: \"kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130907 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130907 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.130907 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.130875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.197167 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.197139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:09.232158 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cdrz\" (UniqueName: \"kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232472 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232472 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.232936 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.233048 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.232999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.233048 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.233013    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.233218 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.233195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.234726 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.234708    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.234726 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.234721    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.240274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.240256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cdrz\" (UniqueName: \"kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz\") pod \"console-5c574bc985-btrfp\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") " pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.254265 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.254238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:09.337504 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.337431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:09.471919 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.471771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:42:09.474172 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:42:09.474149    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1268ff_03b7_4096_a3ef_b18b72d5bda3.slice/crio-7f1554d33e01b5f009f22107754a113279a5116fd04edc503c44a3ff7d391fa0 WatchSource:0}: Error finding container 7f1554d33e01b5f009f22107754a113279a5116fd04edc503c44a3ff7d391fa0: Status 404 returned error can't find the container with id 7f1554d33e01b5f009f22107754a113279a5116fd04edc503c44a3ff7d391fa0
Jul 07 16:42:09.819559 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.819521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:09.879197 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:09.879161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:10.356506 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:10.356476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c574bc985-btrfp" event={"ID":"7c1268ff-03b7-4096-a3ef-b18b72d5bda3","Type":"ContainerStarted","Data":"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"}
Jul 07 16:42:10.356931 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:10.356525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c574bc985-btrfp" event={"ID":"7c1268ff-03b7-4096-a3ef-b18b72d5bda3","Type":"ContainerStarted","Data":"7f1554d33e01b5f009f22107754a113279a5116fd04edc503c44a3ff7d391fa0"}
Jul 07 16:42:10.375632 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:10.375583    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c574bc985-btrfp" podStartSLOduration=1.375568814 podStartE2EDuration="1.375568814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:42:10.375111468 +0000 UTC m=+177.380677694" watchObservedRunningTime="2026-07-07 16:42:10.375568814 +0000 UTC m=+177.381135021"
Jul 07 16:42:14.413689 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:14.413649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:14.467873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:14.467837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:19.337906 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.337867    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:19.338388 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.337955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:19.342565 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.342543    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:19.395159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.395135    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:42:19.444046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.444011    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:42:19.590630 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.590534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:19.692055 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.692024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:19.792961 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:19.792929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:24.762119 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:24.762082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:24.867423 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:24.867358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:25.739778 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:25.739739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:42:44.467009 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.466954    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bd8476d7c-kwqvj" podUID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" containerName="console" containerID="cri-o://e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1" gracePeriod=15
Jul 07 16:42:44.698905 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.698884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:42:44.826083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826002    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9srvv\" (UniqueName: \"kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826101    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826144    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca\") pod \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\" (UID: \"c1d391e5-47af-4a75-aaae-3891aaffcf5a\") "
Jul 07 16:42:44.826595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826571    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:42:44.826658 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826583    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config" (OuterVolumeSpecName: "console-config") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:42:44.826713 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826591    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:42:44.826767 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.826754    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:42:44.828220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.828191    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:42:44.828333 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.828226    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:42:44.828333 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.828269    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv" (OuterVolumeSpecName: "kube-api-access-9srvv") pod "c1d391e5-47af-4a75-aaae-3891aaffcf5a" (UID: "c1d391e5-47af-4a75-aaae-3891aaffcf5a"). InnerVolumeSpecName "kube-api-access-9srvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:42:44.927572 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927544    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9srvv\" (UniqueName: \"kubernetes.io/projected/c1d391e5-47af-4a75-aaae-3891aaffcf5a-kube-api-access-9srvv\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927572 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927571    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927584    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927596    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927607    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927618    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d391e5-47af-4a75-aaae-3891aaffcf5a-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:44.927758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:44.927629    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d391e5-47af-4a75-aaae-3891aaffcf5a-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:42:45.497903 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.497867    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" containerID="e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1" exitCode=0
Jul 07 16:42:45.497903 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.497906    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd8476d7c-kwqvj"
Jul 07 16:42:45.498446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.497932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd8476d7c-kwqvj" event={"ID":"c1d391e5-47af-4a75-aaae-3891aaffcf5a","Type":"ContainerDied","Data":"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"}
Jul 07 16:42:45.498446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.497974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd8476d7c-kwqvj" event={"ID":"c1d391e5-47af-4a75-aaae-3891aaffcf5a","Type":"ContainerDied","Data":"fedeb06a93b2ab6d6d4150ca27a0b53e7c03de0ead7fe424a5d0733010138da6"}
Jul 07 16:42:45.498446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.498001    2565 scope.go:117] "RemoveContainer" containerID="e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"
Jul 07 16:42:45.507080 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.507059    2565 scope.go:117] "RemoveContainer" containerID="e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"
Jul 07 16:42:45.507327 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:42:45.507309    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1\": container with ID starting with e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1 not found: ID does not exist" containerID="e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"
Jul 07 16:42:45.507381 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.507335    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1"} err="failed to get container status \"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1\": rpc error: code = NotFound desc = could not find container \"e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1\": container with ID starting with e61a8cd363de8fc3403a463f04b688871ef55c8c1943d281202c53b42958f2f1 not found: ID does not exist"
Jul 07 16:42:45.522947 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.522923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:42:45.526934 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:45.526893    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd8476d7c-kwqvj"]
Jul 07 16:42:47.499998 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:42:47.496687    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" path="/var/lib/kubelet/pods/c1d391e5-47af-4a75-aaae-3891aaffcf5a/volumes"
Jul 07 16:43:05.420858 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:43:05.420804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:43:14.970310 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:43:14.970263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:13.329540 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:13.329513    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:44:13.332345 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:13.332311    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:44:13.340794 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:13.340774    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 16:44:13.976149 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:13.976106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:14.075371 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.075335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:14.638187 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.638145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:14.641896 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.641873    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:44:14.642203 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.642191    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" containerName="console"
Jul 07 16:44:14.642249 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.642205    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" containerName="console"
Jul 07 16:44:14.642283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.642255    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d391e5-47af-4a75-aaae-3891aaffcf5a" containerName="console"
Jul 07 16:44:14.645129 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.645108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:14.648545 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.648524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-jr6mh\""
Jul 07 16:44:14.648545 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.648537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 07 16:44:14.648686 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.648572    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 07 16:44:14.654457 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.654438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:44:14.745910 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.745882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5jfp\" (UniqueName: \"kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp\") pod \"feast-operator-controller-manager-5cd6c559d5-88cvt\" (UID: \"b07aa603-3471-4742-ae66-73fddb09872f\") " pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:14.846525 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.846497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5jfp\" (UniqueName: \"kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp\") pod \"feast-operator-controller-manager-5cd6c559d5-88cvt\" (UID: \"b07aa603-3471-4742-ae66-73fddb09872f\") " pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:14.855500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.855475    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5jfp\" (UniqueName: \"kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp\") pod \"feast-operator-controller-manager-5cd6c559d5-88cvt\" (UID: \"b07aa603-3471-4742-ae66-73fddb09872f\") " pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:14.956283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:14.956202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:15.082926 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:15.082904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:44:15.085032 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:44:15.085007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07aa603_3471_4742_ae66_73fddb09872f.slice/crio-abcb105411d5d9e151494c62dc1a330dfbee2697e4deddb478f5d4bb31d4cb1a WatchSource:0}: Error finding container abcb105411d5d9e151494c62dc1a330dfbee2697e4deddb478f5d4bb31d4cb1a: Status 404 returned error can't find the container with id abcb105411d5d9e151494c62dc1a330dfbee2697e4deddb478f5d4bb31d4cb1a
Jul 07 16:44:15.086909 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:15.086891    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:44:15.836060 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:15.836027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" event={"ID":"b07aa603-3471-4742-ae66-73fddb09872f","Type":"ContainerStarted","Data":"abcb105411d5d9e151494c62dc1a330dfbee2697e4deddb478f5d4bb31d4cb1a"}
Jul 07 16:44:17.846760 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:17.846662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" event={"ID":"b07aa603-3471-4742-ae66-73fddb09872f","Type":"ContainerStarted","Data":"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"}
Jul 07 16:44:17.847189 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:17.846768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:17.867638 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:17.867582    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" podStartSLOduration=1.421720072 podStartE2EDuration="3.867567299s" totalImagesPullingTime="2.445847227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:44:17.866224562 +0000 UTC m=+304.871790771" watchObservedRunningTime="2026-07-07 16:44:17.867567299 +0000 UTC m=+304.873133548"
Jul 07 16:44:28.852433 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:28.852403    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:44:49.288991 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.288949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:49.385978 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.385944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:49.582182 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.582106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:49.682431 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.682397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:49.691698 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.691669    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:44:49.696712 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.696695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.700058 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 07 16:44:49.700178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 07 16:44:49.700178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700098    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 07 16:44:49.700178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 07 16:44:49.700178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 07 16:44:49.700456 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 07 16:44:49.700456 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700038    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-djtf9\""
Jul 07 16:44:49.700456 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.700070    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 07 16:44:49.708214 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.708195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:44:49.830134 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.830134 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.830373 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.830373 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.830373 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.830373 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.830367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22sq\" (UniqueName: \"kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931327 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22sq\" (UniqueName: \"kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931495 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931495 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931495 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931439    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 07 16:44:49.931495 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931494    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls podName:d80421aa-4ae8-42cc-863a-bbe454819574 nodeName:}" failed. No retries permitted until 2026-07-07 16:44:50.431479539 +0000 UTC m=+337.437045726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls") pod "feast-simple-feast-setup-558d8c658b-x7mt2" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 07 16:44:49.931711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.931650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.931887 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931713    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 07 16:44:49.931887 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931749    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls podName:d80421aa-4ae8-42cc-863a-bbe454819574 nodeName:}" failed. No retries permitted until 2026-07-07 16:44:50.431735857 +0000 UTC m=+337.437302043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls") pod "feast-simple-feast-setup-558d8c658b-x7mt2" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 07 16:44:49.931887 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931746    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 07 16:44:49.931887 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:44:49.931795    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls podName:d80421aa-4ae8-42cc-863a-bbe454819574 nodeName:}" failed. No retries permitted until 2026-07-07 16:44:50.43177949 +0000 UTC m=+337.437345677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls") pod "feast-simple-feast-setup-558d8c658b-x7mt2" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574") : secret "feast-simple-feast-setup-online-tls" not found
Jul 07 16:44:49.934049 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.934030    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:49.938948 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.938920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:49.940169 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:49.940148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22sq\" (UniqueName: \"kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.052477 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.052444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:50.256414 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.256333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:50.332524 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.332491    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:50.436952 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.436916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.437113 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.436969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.437113 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.436998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.439425 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.439397    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.439625 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.439468    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.439625 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.439573    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-x7mt2\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.613832 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.613734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:44:50.754966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.754807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:44:50.757162 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:44:50.757141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd80421aa_4ae8_42cc_863a_bbe454819574.slice/crio-329633d5d98eaa8bfe3399b384f4cf81cb42a9faefd00ba5f86cca1f2601e64a WatchSource:0}: Error finding container 329633d5d98eaa8bfe3399b384f4cf81cb42a9faefd00ba5f86cca1f2601e64a: Status 404 returned error can't find the container with id 329633d5d98eaa8bfe3399b384f4cf81cb42a9faefd00ba5f86cca1f2601e64a
Jul 07 16:44:50.979567 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:50.979538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"329633d5d98eaa8bfe3399b384f4cf81cb42a9faefd00ba5f86cca1f2601e64a"}
Jul 07 16:44:53.125864 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:53.125806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:53.184752 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:44:53.184717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:10.469721 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:10.469639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:10.570460 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:10.570424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:10.824346 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:10.824252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:27.822060 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:27.821956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:28.153246 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:28.153205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"}
Jul 07 16:45:33.174417 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:33.174386    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445" exitCode=0
Jul 07 16:45:33.174884 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:33.174423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"}
Jul 07 16:45:34.179892 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:34.179854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"}
Jul 07 16:45:39.201845 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:39.201790    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21" exitCode=0
Jul 07 16:45:39.202328 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:39.201867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"}
Jul 07 16:45:39.212532 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:39.212515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 07 16:45:40.213042 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.212992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"}
Jul 07 16:45:40.213536 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.213062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"}
Jul 07 16:45:40.213536 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.213083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"}
Jul 07 16:45:40.213536 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.213117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerStarted","Data":"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"}
Jul 07 16:45:40.242765 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.242696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podStartSLOduration=14.525283182999999 podStartE2EDuration="51.242674373s" totalImagesPullingTime="36.71739119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:45:40.240045226 +0000 UTC m=+387.245611459" watchObservedRunningTime="2026-07-07 16:45:40.242674373 +0000 UTC m=+387.248240582"
Jul 07 16:45:40.614096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.613995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:40.614096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.614070    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:40.614096 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.614092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:40.614389 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:40.614109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:41.614095 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.614055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:41.614577 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.614119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:41.614577 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.614139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:41.614577 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.614159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:41.616424 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.616379    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 16:45:41.616642 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.616410    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Jul 07 16:45:41.616787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.616418    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 07 16:45:41.616913 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:41.616420    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Jul 07 16:45:44.614690 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:44.614628    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 16:45:44.614690 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:44.614671    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 07 16:45:44.615276 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:44.614755    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Jul 07 16:45:44.615276 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:44.614970    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Jul 07 16:45:47.615232 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:47.615202    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:47.615785 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:47.615760    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:47.615955 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:47.615933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:47.616036 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:47.615988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:47.620468 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:47.620449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:48.257919 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:48.257892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:48.258102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:48.257968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:48.260932 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:48.260908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:45:48.607451 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:45:48.607370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:04.427193 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:04.427158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:04.498945 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:04.498910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:14.845460 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:14.845419    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:46:14.953583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:14.953547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:15.053956 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:15.053866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:15.108861 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:15.108803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:39.867058 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:39.866942    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c574bc985-btrfp" podUID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" containerName="console" containerID="cri-o://c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26" gracePeriod=15
Jul 07 16:46:40.111039 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.111007    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:46:40.271874 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.271874 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271841    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cdrz\" (UniqueName: \"kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.271874 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.272141 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271890    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.272141 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.272141 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.271988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.272141 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.272008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle\") pod \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\" (UID: \"7c1268ff-03b7-4096-a3ef-b18b72d5bda3\") "
Jul 07 16:46:40.272350 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.272242    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:46:40.272350 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.272314    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config" (OuterVolumeSpecName: "console-config") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:46:40.272484 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.272460    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:46:40.272603 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.272517    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:46:40.274175 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.274146    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:46:40.274296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.274213    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz" (OuterVolumeSpecName: "kube-api-access-5cdrz") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "kube-api-access-5cdrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:46:40.274296 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.274214    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c1268ff-03b7-4096-a3ef-b18b72d5bda3" (UID: "7c1268ff-03b7-4096-a3ef-b18b72d5bda3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:46:40.373247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373215    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373243    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373252    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373457 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373261    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cdrz\" (UniqueName: \"kubernetes.io/projected/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-kube-api-access-5cdrz\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373457 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373270    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373457 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373280    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.373457 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.373287    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c1268ff-03b7-4096-a3ef-b18b72d5bda3-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:46:40.464446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.464408    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" containerID="c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26" exitCode=0
Jul 07 16:46:40.464446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.464448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c574bc985-btrfp"
Jul 07 16:46:40.464672 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.464455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c574bc985-btrfp" event={"ID":"7c1268ff-03b7-4096-a3ef-b18b72d5bda3","Type":"ContainerDied","Data":"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"}
Jul 07 16:46:40.464672 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.464506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c574bc985-btrfp" event={"ID":"7c1268ff-03b7-4096-a3ef-b18b72d5bda3","Type":"ContainerDied","Data":"7f1554d33e01b5f009f22107754a113279a5116fd04edc503c44a3ff7d391fa0"}
Jul 07 16:46:40.464672 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.464529    2565 scope.go:117] "RemoveContainer" containerID="c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"
Jul 07 16:46:40.473108 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.473090    2565 scope.go:117] "RemoveContainer" containerID="c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"
Jul 07 16:46:40.473353 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:46:40.473330    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26\": container with ID starting with c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26 not found: ID does not exist" containerID="c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"
Jul 07 16:46:40.473394 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.473365    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26"} err="failed to get container status \"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26\": rpc error: code = NotFound desc = could not find container \"c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26\": container with ID starting with c40e24f99c698a8931553d64bae87a91236a8afa4ef6cb11a6e2907187692e26 not found: ID does not exist"
Jul 07 16:46:40.485899 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.485878    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:46:40.489903 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:40.489883    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c574bc985-btrfp"]
Jul 07 16:46:41.497207 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:41.497179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" path="/var/lib/kubelet/pods/7c1268ff-03b7-4096-a3ef-b18b72d5bda3/volumes"
Jul 07 16:46:50.947060 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.946997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:50.958472 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.958438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:46:50.958750 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.958720    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry" containerID="cri-o://b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b" gracePeriod=30
Jul 07 16:46:50.958889 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.958840    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline" containerID="cri-o://05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23" gracePeriod=30
Jul 07 16:46:50.958966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.958911    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" containerID="cri-o://450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb" gracePeriod=30
Jul 07 16:46:50.959075 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:50.958739    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" containerID="cri-o://4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432" gracePeriod=30
Jul 07 16:46:51.046711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.046666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.146798 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.146763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.212421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.212336    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:46:51.212668 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.212655    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" containerName="console"
Jul 07 16:46:51.212709 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.212670    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" containerName="console"
Jul 07 16:46:51.212758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.212750    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c1268ff-03b7-4096-a3ef-b18b72d5bda3" containerName="console"
Jul 07 16:46:51.217896 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.217872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.220925 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.220904    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g9hbp\""
Jul 07 16:46:51.230705 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.230677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:46:51.232862 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.232832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.261438 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.261600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.261600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.261600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22l6m\" (UniqueName: \"kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.261709 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.261709 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.261688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.293842 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.293771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.362247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.362247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.362500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22l6m\" (UniqueName: \"kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.362500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.362500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.362500 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.362416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.363330 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.363307    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.365698 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.365673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.366283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.366176    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.366283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.366242    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.366429 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.366403    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.372618 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.372588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22l6m\" (UniqueName: \"kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m\") pod \"feast-simple-feast-setup-558d8c658b-5wv9h\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") " pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.393261 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.393225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.511555 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.511510    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432" exitCode=0
Jul 07 16:46:51.511711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.511571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"}
Jul 07 16:46:51.532920 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.532885    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:46:51.681644 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:51.681620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:46:51.683880 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:46:51.683853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9cccc8d_5154_498f_a2c8_cc9f5804fe4b.slice/crio-bb1f11619c2e852628d748799e3a9f4df59f8ac2637784ace58bf051b567da8c WatchSource:0}: Error finding container bb1f11619c2e852628d748799e3a9f4df59f8ac2637784ace58bf051b567da8c: Status 404 returned error can't find the container with id bb1f11619c2e852628d748799e3a9f4df59f8ac2637784ace58bf051b567da8c
Jul 07 16:46:52.516889 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:52.516841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"}
Jul 07 16:46:52.517360 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:52.516899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"bb1f11619c2e852628d748799e3a9f4df59f8ac2637784ace58bf051b567da8c"}
Jul 07 16:46:52.519648 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:52.519624    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb" exitCode=0
Jul 07 16:46:52.519778 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:52.519690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"}
Jul 07 16:46:56.537002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:56.536969    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571" exitCode=0
Jul 07 16:46:56.537371 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:56.537043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"}
Jul 07 16:46:57.549113 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:57.549069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"}
Jul 07 16:46:58.257583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:58.257529    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 16:46:58.257776 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:46:58.257587    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 07 16:47:02.573013 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:02.572920    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9" exitCode=0
Jul 07 16:47:02.573013 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:02.572994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"}
Jul 07 16:47:03.584640 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:03.584600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"}
Jul 07 16:47:03.585140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:03.584665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"}
Jul 07 16:47:03.585140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:03.584688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"}
Jul 07 16:47:03.585140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:03.584705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerStarted","Data":"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"}
Jul 07 16:47:03.616585 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:03.616520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podStartSLOduration=12.616497715 podStartE2EDuration="12.616497715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:03.6142766 +0000 UTC m=+470.619842826" watchObservedRunningTime="2026-07-07 16:47:03.616497715 +0000 UTC m=+470.622063924"
Jul 07 16:47:06.533632 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.533590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:06.534159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.533661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:06.534159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.533685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:06.534159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.533703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:06.535648 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.535610    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Jul 07 16:47:06.535648 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.535630    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 07 16:47:06.535929 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.535656    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Jul 07 16:47:06.535929 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:06.535757    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 07 16:47:08.258033 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:08.257985    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 16:47:08.258610 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:08.258068    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 07 16:47:09.534199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.534167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.534878 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.534857    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.535002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.534891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.535111 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.535097    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.536104 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.536081    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.545357 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.540186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.619483 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.619452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.619658 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.619500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.619658 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.619521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.619865 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.619840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.619981 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.619917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.622607 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.622584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:47:09.866936 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:09.866903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:18.258540 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:18.258490    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 16:47:18.259004 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:18.258515    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jul 07 16:47:18.259004 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:18.258632    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:47:18.259004 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:18.258692    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:47:21.614842 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.614796    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:47:21.676895 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.676863    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23" exitCode=137
Jul 07 16:47:21.676895 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.676889    2565 generic.go:356] "Generic (PLEG): container finished" podID="d80421aa-4ae8-42cc-863a-bbe454819574" containerID="b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b" exitCode=137
Jul 07 16:47:21.677102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.676928    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"
Jul 07 16:47:21.677102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.676948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"}
Jul 07 16:47:21.677102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.676999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"}
Jul 07 16:47:21.677102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.677030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2" event={"ID":"d80421aa-4ae8-42cc-863a-bbe454819574","Type":"ContainerDied","Data":"329633d5d98eaa8bfe3399b384f4cf81cb42a9faefd00ba5f86cca1f2601e64a"}
Jul 07 16:47:21.677102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.677049    2565 scope.go:117] "RemoveContainer" containerID="4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"
Jul 07 16:47:21.685580 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.685564    2565 scope.go:117] "RemoveContainer" containerID="05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"
Jul 07 16:47:21.692712 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.692697    2565 scope.go:117] "RemoveContainer" containerID="450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"
Jul 07 16:47:21.701357 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.701338    2565 scope.go:117] "RemoveContainer" containerID="b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"
Jul 07 16:47:21.708301 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.708286    2565 scope.go:117] "RemoveContainer" containerID="56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"
Jul 07 16:47:21.715281 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.715267    2565 scope.go:117] "RemoveContainer" containerID="152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"
Jul 07 16:47:21.721307 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721283    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x22sq\" (UniqueName: \"kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.721407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.721407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721363    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.721407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.721562 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.721562 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") pod \"d80421aa-4ae8-42cc-863a-bbe454819574\" (UID: \"d80421aa-4ae8-42cc-863a-bbe454819574\") "
Jul 07 16:47:21.722029 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.721991    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data" (OuterVolumeSpecName: "feast-data") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:21.722552 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.722502    2565 scope.go:117] "RemoveContainer" containerID="4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"
Jul 07 16:47:21.723153 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.723004    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432\": container with ID starting with 4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432 not found: ID does not exist" containerID="4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"
Jul 07 16:47:21.723153 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723059    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"} err="failed to get container status \"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432\": rpc error: code = NotFound desc = could not find container \"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432\": container with ID starting with 4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432 not found: ID does not exist"
Jul 07 16:47:21.723153 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723084    2565 scope.go:117] "RemoveContainer" containerID="05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"
Jul 07 16:47:21.723393 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.723340    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23\": container with ID starting with 05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23 not found: ID does not exist" containerID="05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"
Jul 07 16:47:21.723453 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723384    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"} err="failed to get container status \"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23\": rpc error: code = NotFound desc = could not find container \"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23\": container with ID starting with 05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23 not found: ID does not exist"
Jul 07 16:47:21.723453 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723405    2565 scope.go:117] "RemoveContainer" containerID="450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"
Jul 07 16:47:21.723712 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.723687    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb\": container with ID starting with 450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb not found: ID does not exist" containerID="450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"
Jul 07 16:47:21.723850 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723713    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"} err="failed to get container status \"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb\": rpc error: code = NotFound desc = could not find container \"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb\": container with ID starting with 450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb not found: ID does not exist"
Jul 07 16:47:21.723850 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723733    2565 scope.go:117] "RemoveContainer" containerID="b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"
Jul 07 16:47:21.724025 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723985    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls" (OuterVolumeSpecName: "online-tls") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:47:21.724025 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.723998    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:47:21.724163 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.724034    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b\": container with ID starting with b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b not found: ID does not exist" containerID="b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"
Jul 07 16:47:21.724163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724061    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"} err="failed to get container status \"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b\": rpc error: code = NotFound desc = could not find container \"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b\": container with ID starting with b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b not found: ID does not exist"
Jul 07 16:47:21.724163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724079    2565 scope.go:117] "RemoveContainer" containerID="56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"
Jul 07 16:47:21.724163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724081    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq" (OuterVolumeSpecName: "kube-api-access-x22sq") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "kube-api-access-x22sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:47:21.724163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724145    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:47:21.724395 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.724335    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21\": container with ID starting with 56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21 not found: ID does not exist" containerID="56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"
Jul 07 16:47:21.724395 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724341    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d80421aa-4ae8-42cc-863a-bbe454819574" (UID: "d80421aa-4ae8-42cc-863a-bbe454819574"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:47:21.724395 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724356    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"} err="failed to get container status \"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21\": rpc error: code = NotFound desc = could not find container \"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21\": container with ID starting with 56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21 not found: ID does not exist"
Jul 07 16:47:21.724395 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724370    2565 scope.go:117] "RemoveContainer" containerID="152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"
Jul 07 16:47:21.724628 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:47:21.724582    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445\": container with ID starting with 152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445 not found: ID does not exist" containerID="152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"
Jul 07 16:47:21.724628 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724615    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"} err="failed to get container status \"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445\": rpc error: code = NotFound desc = could not find container \"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445\": container with ID starting with 152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445 not found: ID does not exist"
Jul 07 16:47:21.724707 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724638    2565 scope.go:117] "RemoveContainer" containerID="4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"
Jul 07 16:47:21.724932 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724911    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432"} err="failed to get container status \"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432\": rpc error: code = NotFound desc = could not find container \"4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432\": container with ID starting with 4b0a5a2e53f6744960e71135ce686934a5b0d3247ca7e896c8365670e8440432 not found: ID does not exist"
Jul 07 16:47:21.725014 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.724933    2565 scope.go:117] "RemoveContainer" containerID="05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"
Jul 07 16:47:21.725179 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725161    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23"} err="failed to get container status \"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23\": rpc error: code = NotFound desc = could not find container \"05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23\": container with ID starting with 05fc31ab2b0504fe9211157a9a7889686d3d4f509f6c8f039782dedf9ce63d23 not found: ID does not exist"
Jul 07 16:47:21.725226 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725180    2565 scope.go:117] "RemoveContainer" containerID="450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"
Jul 07 16:47:21.725405 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725381    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb"} err="failed to get container status \"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb\": rpc error: code = NotFound desc = could not find container \"450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb\": container with ID starting with 450f18ae3fd71a305f2c77718a9ec0f38eadac2f3f1fb2d45686f7efe9f7d8fb not found: ID does not exist"
Jul 07 16:47:21.725510 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725404    2565 scope.go:117] "RemoveContainer" containerID="b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"
Jul 07 16:47:21.725673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725655    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b"} err="failed to get container status \"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b\": rpc error: code = NotFound desc = could not find container \"b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b\": container with ID starting with b7f00a9b85030f27ebbae2c5203129a8beb948b1e4473e9a74c262165a0b4e9b not found: ID does not exist"
Jul 07 16:47:21.725728 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725676    2565 scope.go:117] "RemoveContainer" containerID="56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"
Jul 07 16:47:21.725944 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725927    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21"} err="failed to get container status \"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21\": rpc error: code = NotFound desc = could not find container \"56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21\": container with ID starting with 56890d349f0dbd95f887b431d886f30dc72c3027267f0eb95edf78fd75fe0c21 not found: ID does not exist"
Jul 07 16:47:21.726009 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.725945    2565 scope.go:117] "RemoveContainer" containerID="152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"
Jul 07 16:47:21.726155 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.726139    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445"} err="failed to get container status \"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445\": rpc error: code = NotFound desc = could not find container \"152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445\": container with ID starting with 152c2b73bdce3eaf287b78a07ff4b22facf68597f42804ae367cf3772e2dd445 not found: ID does not exist"
Jul 07 16:47:21.822357 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822326    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-ui-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:21.822357 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822351    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x22sq\" (UniqueName: \"kubernetes.io/projected/d80421aa-4ae8-42cc-863a-bbe454819574-kube-api-access-x22sq\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:21.822357 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822361    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:21.822561 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822370    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:21.822561 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822379    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d80421aa-4ae8-42cc-863a-bbe454819574-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:21.822561 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:21.822386    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d80421aa-4ae8-42cc-863a-bbe454819574-offline-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:47:22.002561 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:22.002534    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:47:22.006435 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:22.006409    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-x7mt2"]
Jul 07 16:47:23.496969 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:47:23.496936    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" path="/var/lib/kubelet/pods/d80421aa-4ae8-42cc-863a-bbe454819574/volumes"
Jul 07 16:48:10.725892 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.725777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:10.826700 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.826663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:10.927452 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.927422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:10.984040 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.983965    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:48:10.984273 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984261    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984274    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984285    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984290    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984297    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984302    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="feast-apply"
Jul 07 16:48:10.984314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984314    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="feast-apply"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984337    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="feast-init"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984343    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="feast-init"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984404    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="offline"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984414    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="registry"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984419    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="ui"
Jul 07 16:48:10.984533 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.984425    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d80421aa-4ae8-42cc-863a-bbe454819574" containerName="online"
Jul 07 16:48:10.987937 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.987917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:10.991169 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.991146    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 07 16:48:10.991274 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.991152    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 07 16:48:10.993083 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.993067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 07 16:48:10.993170 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.993067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-4n4jj\""
Jul 07 16:48:10.993392 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.993376    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 07 16:48:10.993803 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.993785    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 07 16:48:10.994119 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.994102    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 07 16:48:10.994179 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:10.994105    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 07 16:48:11.013722 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.013700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:48:11.020195 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.020294 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl479\" (UniqueName: \"kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.020294 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.020367 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.020367 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.020436 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.020421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.026171 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.026143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:11.105035 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.104988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:11.121016 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.120993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl479\" (UniqueName: \"kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121174 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121421 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:48:11.121272    2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 07 16:48:11.121421 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:48:11.121348    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls podName:63be6c1c-c3ea-4194-a5f5-9141e9f7b675 nodeName:}" failed. No retries permitted until 2026-07-07 16:48:11.621325976 +0000 UTC m=+538.626892166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls") pod "feast-simple-feast-remote-setup-578979dbd4-w6mfv" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 07 16:48:11.121515 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121440    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.121836 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.121793    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.123502 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.123483    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.123673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.123655    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.130075 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.130044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl479\" (UniqueName: \"kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.205528 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.205494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:11.626506 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.626478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.628938 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.628906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") pod \"feast-simple-feast-remote-setup-578979dbd4-w6mfv\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:11.898154 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:11.898069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:12.033973 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:12.033944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:48:12.035106 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:48:12.035077    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63be6c1c_c3ea_4194_a5f5_9141e9f7b675.slice/crio-ebf5a4523f9c6d46920ac3b132334b208e2f7f13ab0181224b94116a60878918 WatchSource:0}: Error finding container ebf5a4523f9c6d46920ac3b132334b208e2f7f13ab0181224b94116a60878918: Status 404 returned error can't find the container with id ebf5a4523f9c6d46920ac3b132334b208e2f7f13ab0181224b94116a60878918
Jul 07 16:48:12.880002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:12.879964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"3b320a454e3ab9c77bfd21cd0552db27c1b2c7da0360a18fba1d0e49383952ce"}
Jul 07 16:48:12.880002 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:12.880009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"ebf5a4523f9c6d46920ac3b132334b208e2f7f13ab0181224b94116a60878918"}
Jul 07 16:48:16.897460 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:16.897424    2565 generic.go:356] "Generic (PLEG): container finished" podID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerID="3b320a454e3ab9c77bfd21cd0552db27c1b2c7da0360a18fba1d0e49383952ce" exitCode=0
Jul 07 16:48:16.897835 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:16.897496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"3b320a454e3ab9c77bfd21cd0552db27c1b2c7da0360a18fba1d0e49383952ce"}
Jul 07 16:48:17.903177 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:17.903142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"a3c989ba8ec93c7c4fc307ed1179255f319355ac095032affef18cc80dc0842e"}
Jul 07 16:48:22.924299 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:22.924266    2565 generic.go:356] "Generic (PLEG): container finished" podID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerID="a3c989ba8ec93c7c4fc307ed1179255f319355ac095032affef18cc80dc0842e" exitCode=0
Jul 07 16:48:22.924684 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:22.924306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"a3c989ba8ec93c7c4fc307ed1179255f319355ac095032affef18cc80dc0842e"}
Jul 07 16:48:22.929585 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:22.929566    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 07 16:48:23.933113 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:23.933077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"b7e2a3bab0dcec92a91be039f368a0e24ab03f2b235c4dcaa126d62f952a3b37"}
Jul 07 16:48:23.933610 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:23.933137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"de842975d878fa2c0e3155b59063c1925e0aee81487bf7a60ad71ce4398f1978"}
Jul 07 16:48:23.933610 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:23.933158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerStarted","Data":"6f316c999467542e4eefb525a33ed05bca311943c29dbbad8930c8d45ccbe72f"}
Jul 07 16:48:23.960832 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:23.960751    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podStartSLOduration=13.96073462 podStartE2EDuration="13.96073462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:23.959460572 +0000 UTC m=+550.965026805" watchObservedRunningTime="2026-07-07 16:48:23.96073462 +0000 UTC m=+550.966300828"
Jul 07 16:48:26.898197 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.898155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:26.898674 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.898227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:26.898674 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.898589    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:26.900421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.900381    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Jul 07 16:48:26.900421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.900410    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jul 07 16:48:26.900575 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:26.900412    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 07 16:48:29.899131 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.899100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.899635 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.899610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.899714 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.899654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.899946 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.899929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.905545 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.905525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.961929 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.961900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.961929 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.961938    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.962585 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.962567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:29.966440 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:29.966420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:48:30.209038 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:48:30.208945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:13.368352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:13.368325    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:49:13.369278 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:13.369258    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:49:32.284055 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.284015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:32.305165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.305130    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:49:32.305437 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.305407    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online" containerID="cri-o://6f316c999467542e4eefb525a33ed05bca311943c29dbbad8930c8d45ccbe72f" gracePeriod=30
Jul 07 16:49:32.305711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.305476    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="offline" containerID="cri-o://de842975d878fa2c0e3155b59063c1925e0aee81487bf7a60ad71ce4398f1978" gracePeriod=30
Jul 07 16:49:32.305828 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.305465    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui" containerID="cri-o://b7e2a3bab0dcec92a91be039f368a0e24ab03f2b235c4dcaa126d62f952a3b37" gracePeriod=30
Jul 07 16:49:32.417000 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.416969    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:49:32.417231 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.417209    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="registry" containerID="cri-o://de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d" gracePeriod=30
Jul 07 16:49:32.417331 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.417307    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui" containerID="cri-o://e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b" gracePeriod=30
Jul 07 16:49:32.417398 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.417322    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="offline" containerID="cri-o://b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7" gracePeriod=30
Jul 07 16:49:32.417398 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:32.417315    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online" containerID="cri-o://971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef" gracePeriod=30
Jul 07 16:49:33.223283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.223253    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b" exitCode=0
Jul 07 16:49:33.223283 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.223278    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef" exitCode=0
Jul 07 16:49:33.223541 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.223331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"}
Jul 07 16:49:33.223541 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.223371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"}
Jul 07 16:49:33.225666 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.225645    2565 generic.go:356] "Generic (PLEG): container finished" podID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerID="b7e2a3bab0dcec92a91be039f368a0e24ab03f2b235c4dcaa126d62f952a3b37" exitCode=0
Jul 07 16:49:33.225666 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.225665    2565 generic.go:356] "Generic (PLEG): container finished" podID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerID="6f316c999467542e4eefb525a33ed05bca311943c29dbbad8930c8d45ccbe72f" exitCode=0
Jul 07 16:49:33.225804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.225683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"b7e2a3bab0dcec92a91be039f368a0e24ab03f2b235c4dcaa126d62f952a3b37"}
Jul 07 16:49:33.225804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.225709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"6f316c999467542e4eefb525a33ed05bca311943c29dbbad8930c8d45ccbe72f"}
Jul 07 16:49:33.532307 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:33.532270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:37.563279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:37.563192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:39.619731 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:39.619691    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 07 16:49:39.619731 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:39.619713    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 07 16:49:39.962985 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:39.962889    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jul 07 16:49:39.962985 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:39.962964    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 07 16:49:49.619507 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:49.619459    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 07 16:49:49.620026 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:49.619531    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 07 16:49:49.962905 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:49.962777    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jul 07 16:49:49.962905 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:49.962790    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 07 16:49:59.619717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.619660    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jul 07 16:49:59.620191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.619713    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 07 16:49:59.620191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.619798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:49:59.620191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.619892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:49:59.962634 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.962541    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Jul 07 16:49:59.962780 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.962544    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 07 16:49:59.962780 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.962660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:49:59.962780 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:49:59.962725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:50:02.352527 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:02.352492    2565 generic.go:356] "Generic (PLEG): container finished" podID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerID="de842975d878fa2c0e3155b59063c1925e0aee81487bf7a60ad71ce4398f1978" exitCode=137
Jul 07 16:50:02.352894 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:02.352545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"de842975d878fa2c0e3155b59063c1925e0aee81487bf7a60ad71ce4398f1978"}
Jul 07 16:50:02.964722 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:02.964689    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:50:03.043976 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.043946    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044071    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044157 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044311 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl479\" (UniqueName: \"kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479\") pod \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\" (UID: \"63be6c1c-c3ea-4194-a5f5-9141e9f7b675\") "
Jul 07 16:50:03.044419 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044361    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:50:03.044613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044586    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data" (OuterVolumeSpecName: "feast-data") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:50:03.044789 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044736    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.044789 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.044768    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.046627 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.046600    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls" (OuterVolumeSpecName: "online-tls") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.046730 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.046658    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479" (OuterVolumeSpecName: "kube-api-access-rl479") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "kube-api-access-rl479". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:50:03.046730 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.046685    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.046950 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.046837    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "63be6c1c-c3ea-4194-a5f5-9141e9f7b675" (UID: "63be6c1c-c3ea-4194-a5f5-9141e9f7b675"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.067247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.067227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:50:03.145739 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.145962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.145962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145807    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.145962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145890    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22l6m\" (UniqueName: \"kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.145962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145928    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.145962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.145952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls\") pod \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\" (UID: \"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b\") "
Jul 07 16:50:03.146220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.146155    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.146220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.146171    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-ui-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.146220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.146184    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-offline-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.146220 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.146198    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl479\" (UniqueName: \"kubernetes.io/projected/63be6c1c-c3ea-4194-a5f5-9141e9f7b675-kube-api-access-rl479\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.146484 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.146455    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data" (OuterVolumeSpecName: "feast-data") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:50:03.148052 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.148028    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.148159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.148050    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls" (OuterVolumeSpecName: "online-tls") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.148159 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.148093    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m" (OuterVolumeSpecName: "kube-api-access-22l6m") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "kube-api-access-22l6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:50:03.148308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.148288    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.148400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.148350    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" (UID: "e9cccc8d-5154-498f-a2c8-cc9f5804fe4b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:50:03.246664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246632    2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-ui-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.246664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246659    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.246664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246669    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-offline-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.246664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246677    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.246945 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246685    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.246945 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.246694    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22l6m\" (UniqueName: \"kubernetes.io/projected/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b-kube-api-access-22l6m\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:50:03.359764 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359729    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7" exitCode=137
Jul 07 16:50:03.359764 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359760    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerID="de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d" exitCode=137
Jul 07 16:50:03.360279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359792    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"
Jul 07 16:50:03.360279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"}
Jul 07 16:50:03.360279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"}
Jul 07 16:50:03.360279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h" event={"ID":"e9cccc8d-5154-498f-a2c8-cc9f5804fe4b","Type":"ContainerDied","Data":"bb1f11619c2e852628d748799e3a9f4df59f8ac2637784ace58bf051b567da8c"}
Jul 07 16:50:03.360279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.359925    2565 scope.go:117] "RemoveContainer" containerID="e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"
Jul 07 16:50:03.362538 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.362517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv" event={"ID":"63be6c1c-c3ea-4194-a5f5-9141e9f7b675","Type":"ContainerDied","Data":"ebf5a4523f9c6d46920ac3b132334b208e2f7f13ab0181224b94116a60878918"}
Jul 07 16:50:03.362645 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.362542    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"
Jul 07 16:50:03.370125 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.370104    2565 scope.go:117] "RemoveContainer" containerID="b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"
Jul 07 16:50:03.377717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.377700    2565 scope.go:117] "RemoveContainer" containerID="971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"
Jul 07 16:50:03.384646 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.384619    2565 scope.go:117] "RemoveContainer" containerID="de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"
Jul 07 16:50:03.391776 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.391760    2565 scope.go:117] "RemoveContainer" containerID="c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"
Jul 07 16:50:03.402231 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.402214    2565 scope.go:117] "RemoveContainer" containerID="0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"
Jul 07 16:50:03.405955 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.405931    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:50:03.410128 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410112    2565 scope.go:117] "RemoveContainer" containerID="e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"
Jul 07 16:50:03.410413 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.410393    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b\": container with ID starting with e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b not found: ID does not exist" containerID="e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"
Jul 07 16:50:03.410483 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410423    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"} err="failed to get container status \"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b\": rpc error: code = NotFound desc = could not find container \"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b\": container with ID starting with e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b not found: ID does not exist"
Jul 07 16:50:03.410483 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410441    2565 scope.go:117] "RemoveContainer" containerID="b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"
Jul 07 16:50:03.410677 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.410664    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7\": container with ID starting with b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7 not found: ID does not exist" containerID="b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"
Jul 07 16:50:03.410724 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410679    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"} err="failed to get container status \"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7\": rpc error: code = NotFound desc = could not find container \"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7\": container with ID starting with b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7 not found: ID does not exist"
Jul 07 16:50:03.410724 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410691    2565 scope.go:117] "RemoveContainer" containerID="971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"
Jul 07 16:50:03.410929 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.410910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef\": container with ID starting with 971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef not found: ID does not exist" containerID="971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"
Jul 07 16:50:03.411046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410928    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"} err="failed to get container status \"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef\": rpc error: code = NotFound desc = could not find container \"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef\": container with ID starting with 971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef not found: ID does not exist"
Jul 07 16:50:03.411046 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.410941    2565 scope.go:117] "RemoveContainer" containerID="de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"
Jul 07 16:50:03.411171 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.411150    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d\": container with ID starting with de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d not found: ID does not exist" containerID="de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"
Jul 07 16:50:03.411230 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411180    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"} err="failed to get container status \"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d\": rpc error: code = NotFound desc = could not find container \"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d\": container with ID starting with de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d not found: ID does not exist"
Jul 07 16:50:03.411230 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411204    2565 scope.go:117] "RemoveContainer" containerID="c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"
Jul 07 16:50:03.411444 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.411400    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9\": container with ID starting with c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9 not found: ID does not exist" containerID="c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"
Jul 07 16:50:03.411444 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411416    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"} err="failed to get container status \"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9\": rpc error: code = NotFound desc = could not find container \"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9\": container with ID starting with c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9 not found: ID does not exist"
Jul 07 16:50:03.411444 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411426    2565 scope.go:117] "RemoveContainer" containerID="0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"
Jul 07 16:50:03.411630 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:03.411612    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571\": container with ID starting with 0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571 not found: ID does not exist" containerID="0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"
Jul 07 16:50:03.411694 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411637    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"} err="failed to get container status \"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571\": rpc error: code = NotFound desc = could not find container \"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571\": container with ID starting with 0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571 not found: ID does not exist"
Jul 07 16:50:03.411694 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411662    2565 scope.go:117] "RemoveContainer" containerID="e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"
Jul 07 16:50:03.411872 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411852    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b"} err="failed to get container status \"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b\": rpc error: code = NotFound desc = could not find container \"e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b\": container with ID starting with e19d6eb83ddf69c2b42ea7f8a1da0c55ec5e485a64920b9815513925d557c87b not found: ID does not exist"
Jul 07 16:50:03.411872 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.411871    2565 scope.go:117] "RemoveContainer" containerID="b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"
Jul 07 16:50:03.412071 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412056    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7"} err="failed to get container status \"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7\": rpc error: code = NotFound desc = could not find container \"b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7\": container with ID starting with b38c40ca0f1960925e4ef72b131c7928f7a8812e545ae5f009539538cba9d0c7 not found: ID does not exist"
Jul 07 16:50:03.412115 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412071    2565 scope.go:117] "RemoveContainer" containerID="971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"
Jul 07 16:50:03.412271 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412254    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef"} err="failed to get container status \"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef\": rpc error: code = NotFound desc = could not find container \"971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef\": container with ID starting with 971e6905114d797b0952551827def555cdaf8aacda3b1421826a568d959e2aef not found: ID does not exist"
Jul 07 16:50:03.412312 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412271    2565 scope.go:117] "RemoveContainer" containerID="de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"
Jul 07 16:50:03.412465 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412447    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d"} err="failed to get container status \"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d\": rpc error: code = NotFound desc = could not find container \"de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d\": container with ID starting with de7d54698fbb4f2a74d83a06cc1af1b3a6c27891ad05f995e9843cd261e39d8d not found: ID does not exist"
Jul 07 16:50:03.412540 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412467    2565 scope.go:117] "RemoveContainer" containerID="c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"
Jul 07 16:50:03.412665 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412649    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9"} err="failed to get container status \"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9\": rpc error: code = NotFound desc = could not find container \"c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9\": container with ID starting with c2506387576e12f1d761382b1a429baabd71b3c1611803073fddafdebfab74e9 not found: ID does not exist"
Jul 07 16:50:03.412711 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412666    2565 scope.go:117] "RemoveContainer" containerID="0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"
Jul 07 16:50:03.412848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412830    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571"} err="failed to get container status \"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571\": rpc error: code = NotFound desc = could not find container \"0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571\": container with ID starting with 0975e4f5d945f70f7519617857134b28fa0264795a15500569b01a5ad32b6571 not found: ID does not exist"
Jul 07 16:50:03.412896 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.412849    2565 scope.go:117] "RemoveContainer" containerID="b7e2a3bab0dcec92a91be039f368a0e24ab03f2b235c4dcaa126d62f952a3b37"
Jul 07 16:50:03.418659 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.418636    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-558d8c658b-5wv9h"]
Jul 07 16:50:03.420990 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.420971    2565 scope.go:117] "RemoveContainer" containerID="de842975d878fa2c0e3155b59063c1925e0aee81487bf7a60ad71ce4398f1978"
Jul 07 16:50:03.428421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.428403    2565 scope.go:117] "RemoveContainer" containerID="6f316c999467542e4eefb525a33ed05bca311943c29dbbad8930c8d45ccbe72f"
Jul 07 16:50:03.435931 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.435911    2565 scope.go:117] "RemoveContainer" containerID="a3c989ba8ec93c7c4fc307ed1179255f319355ac095032affef18cc80dc0842e"
Jul 07 16:50:03.443661 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.443641    2565 scope.go:117] "RemoveContainer" containerID="3b320a454e3ab9c77bfd21cd0552db27c1b2c7da0360a18fba1d0e49383952ce"
Jul 07 16:50:03.445351 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.445328    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:50:03.499333 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.499304    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" path="/var/lib/kubelet/pods/e9cccc8d-5154-498f-a2c8-cc9f5804fe4b/volumes"
Jul 07 16:50:03.499753 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:03.499740    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578979dbd4-w6mfv"]
Jul 07 16:50:05.497750 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:05.497712    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" path="/var/lib/kubelet/pods/63be6c1c-c3ea-4194-a5f5-9141e9f7b675/volumes"
Jul 07 16:50:05.530597 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:05.530557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:15.119407 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.119372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:15.341724 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.341688    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:50:15.342144 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342130    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="offline"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342147    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="offline"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342159    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="registry"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="registry"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342171    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342176    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342185    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="offline"
Jul 07 16:50:15.342199 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342193    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="offline"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342205    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="feast-init"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342214    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="feast-init"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="feast-apply"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="feast-apply"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342261    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342266    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342272    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="feast-init"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342281    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="feast-init"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342287    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342292    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342299    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="feast-apply"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342304    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="feast-apply"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342314    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342370    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="online"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342383    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="registry"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342393    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="online"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342402    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="ui"
Jul 07 16:50:15.342404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342410    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cccc8d-5154-498f-a2c8-cc9f5804fe4b" containerName="offline"
Jul 07 16:50:15.342994 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342419    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="ui"
Jul 07 16:50:15.342994 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.342428    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63be6c1c-c3ea-4194-a5f5-9141e9f7b675" containerName="offline"
Jul 07 16:50:15.346910 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.346893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.353150 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.352968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 07 16:50:15.353263 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.353243    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 07 16:50:15.354140 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.354125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-t6hpr\""
Jul 07 16:50:15.354197 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.354127    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 07 16:50:15.360973 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.360952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:50:15.394682 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.394604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:15.444028 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.443999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.444028 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.444027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlzbh\" (UniqueName: \"kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.495175 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.495145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:15.545478 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.545450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.545478 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.545479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlzbh\" (UniqueName: \"kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.545930 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.545914    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.554721 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.554702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlzbh\" (UniqueName: \"kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh\") pod \"postgres-864846d4f5-8pnv7\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") " pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.667986 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.667909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:50:15.794371 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.794299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:50:15.796705 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:50:15.796674    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d2465cf_5d21_4960_ba02_3a200e888ce2.slice/crio-20c0439538c8687f4f1b59162d226c2512a8652f5b51e7dd39e629111384fb15 WatchSource:0}: Error finding container 20c0439538c8687f4f1b59162d226c2512a8652f5b51e7dd39e629111384fb15: Status 404 returned error can't find the container with id 20c0439538c8687f4f1b59162d226c2512a8652f5b51e7dd39e629111384fb15
Jul 07 16:50:15.798664 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:15.798649    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:50:16.417242 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:16.417201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8pnv7" event={"ID":"6d2465cf-5d21-4960-ba02-3a200e888ce2","Type":"ContainerStarted","Data":"20c0439538c8687f4f1b59162d226c2512a8652f5b51e7dd39e629111384fb15"}
Jul 07 16:50:22.445527 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:22.445488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8pnv7" event={"ID":"6d2465cf-5d21-4960-ba02-3a200e888ce2","Type":"ContainerStarted","Data":"cba3c414dfa1622441ea50b3a76989354a871836734f1985199345f0d7d48c82"}
Jul 07 16:50:22.462622 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:22.462578    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-8pnv7" podStartSLOduration=1.180449332 podStartE2EDuration="7.462563713s" totalImagesPullingTime="6.282114381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:22.460464283 +0000 UTC m=+669.466030493" watchObservedRunningTime="2026-07-07 16:50:22.462563713 +0000 UTC m=+669.468129921"
Jul 07 16:50:25.866382 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.866343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:25.967191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.967160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:25.981678 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.981651    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:50:25.988033 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.988009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:25.991562 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.991546    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 07 16:50:25.992013 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.991993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 07 16:50:25.992132 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.992035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 07 16:50:25.992247 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.992226    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 07 16:50:25.992464 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:25.992450    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-mxdlh\""
Jul 07 16:50:26.039676 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.039645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28zwb\" (UniqueName: \"kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.039846 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.039684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.039846 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.039707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.039846 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.039795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.039962 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.039845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.057405 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.057379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:50:26.066704 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.066678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:26.140674 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.140646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28zwb\" (UniqueName: \"kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.140684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.140703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.140729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:26.140797    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:26.140841    2565 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.140867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.140804 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:26.140890    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls podName:2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9 nodeName:}" failed. No retries permitted until 2026-07-07 16:50:26.640870744 +0000 UTC m=+673.646436945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls") pod "feast-credit-scoring-6c47b54cb9-nss2b" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9") : secret "feast-credit-scoring-offline-tls" not found
Jul 07 16:50:26.141243 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:50:26.140929    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls podName:2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9 nodeName:}" failed. No retries permitted until 2026-07-07 16:50:26.640911286 +0000 UTC m=+673.646477472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls") pod "feast-credit-scoring-6c47b54cb9-nss2b" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9") : secret "feast-credit-scoring-online-tls" not found
Jul 07 16:50:26.141288 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.141255    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.143081 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.143061    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.150657 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.150637    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28zwb\" (UniqueName: \"kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.232835 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.232776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:26.477890 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.477770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:26.645758 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.645721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.645952 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.645770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.648202 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.648177    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.648202 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.648190    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") pod \"feast-credit-scoring-6c47b54cb9-nss2b\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") " pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:26.897787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:26.897754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:27.054856 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:27.054832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:50:27.057022 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:50:27.056978    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4a97a9_51a1_402f_9beb_f5bcc7f87ec9.slice/crio-290fd5dccf913587a9585dad9e8e2d178bd760cf8ce97795ebbf4eb54a0a8bae WatchSource:0}: Error finding container 290fd5dccf913587a9585dad9e8e2d178bd760cf8ce97795ebbf4eb54a0a8bae: Status 404 returned error can't find the container with id 290fd5dccf913587a9585dad9e8e2d178bd760cf8ce97795ebbf4eb54a0a8bae
Jul 07 16:50:27.467959 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:27.467922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"ce4903a214e8b48af9b0f04c4d4894d6bda67e22188adf8fa23c35264dee83a5"}
Jul 07 16:50:27.468134 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:27.467985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"290fd5dccf913587a9585dad9e8e2d178bd760cf8ce97795ebbf4eb54a0a8bae"}
Jul 07 16:50:28.472797 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:28.472767    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerID="ce4903a214e8b48af9b0f04c4d4894d6bda67e22188adf8fa23c35264dee83a5" exitCode=0
Jul 07 16:50:28.473207 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:28.472858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"ce4903a214e8b48af9b0f04c4d4894d6bda67e22188adf8fa23c35264dee83a5"}
Jul 07 16:50:29.479243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:29.479207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"85361bbdec63cf6b7a183e8a857f2b438e00cc6b795d7808729f0c350c6e3f95"}
Jul 07 16:50:35.506011 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:35.505977    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerID="85361bbdec63cf6b7a183e8a857f2b438e00cc6b795d7808729f0c350c6e3f95" exitCode=0
Jul 07 16:50:35.506404 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:35.506042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"85361bbdec63cf6b7a183e8a857f2b438e00cc6b795d7808729f0c350c6e3f95"}
Jul 07 16:50:36.518177 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.518139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"24e209a4b227ed0ed010180c53750d4421c68e0309582ac2099799942fff0184"}
Jul 07 16:50:36.518582 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.518244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"e3d517742ef881f1f775a964ac6221bf8bf9d063cd54ed12e8b3bbda0eb3db7b"}
Jul 07 16:50:36.518582 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.518274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerStarted","Data":"2e364c40a06e1f91bc069532d9c892a34dcbab1ac73038d8522c5350f1bf460a"}
Jul 07 16:50:36.548967 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.548917    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podStartSLOduration=11.548900833 podStartE2EDuration="11.548900833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:36.548597727 +0000 UTC m=+683.554163961" watchObservedRunningTime="2026-07-07 16:50:36.548900833 +0000 UTC m=+683.554467040"
Jul 07 16:50:36.898163 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.898130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:36.898348 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.898208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:36.898348 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:36.898233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:38.898383 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.898294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:38.898383 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.898370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:38.898383 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.898395    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:38.900219 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.900147    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 07 16:50:38.900219 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.900184    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Jul 07 16:50:38.900219 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:38.900206    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 07 16:50:41.898437 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:41.898378    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 07 16:50:41.899409 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:41.899384    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:41.900186 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:41.900168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:41.906178 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:41.906151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:42.552325 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:42.552293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:44.898491 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:44.898442    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 07 16:50:45.644229 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:45.644196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:45.707170 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:45.707113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:47.899524 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:47.899489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:47.900242 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:47.900222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:50:48.165340 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:50:48.165250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:47.636388 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:47.636353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:47.708774 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:47.708738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:52.621012 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.620977    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:51:52.621465 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.621230    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry" containerID="cri-o://2e364c40a06e1f91bc069532d9c892a34dcbab1ac73038d8522c5350f1bf460a" gracePeriod=30
Jul 07 16:51:52.621465 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.621266    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="offline" containerID="cri-o://24e209a4b227ed0ed010180c53750d4421c68e0309582ac2099799942fff0184" gracePeriod=30
Jul 07 16:51:52.621465 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.621316    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online" containerID="cri-o://e3d517742ef881f1f775a964ac6221bf8bf9d063cd54ed12e8b3bbda0eb3db7b" gracePeriod=30
Jul 07 16:51:52.639777 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.639752    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:51:52.639950 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.639930    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-8pnv7" podUID="6d2465cf-5d21-4960-ba02-3a200e888ce2" containerName="postgres" containerID="cri-o://cba3c414dfa1622441ea50b3a76989354a871836734f1985199345f0d7d48c82" gracePeriod=30
Jul 07 16:51:52.699541 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.699510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:52.841438 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.841406    2565 generic.go:356] "Generic (PLEG): container finished" podID="6d2465cf-5d21-4960-ba02-3a200e888ce2" containerID="cba3c414dfa1622441ea50b3a76989354a871836734f1985199345f0d7d48c82" exitCode=0
Jul 07 16:51:52.841597 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.841455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8pnv7" event={"ID":"6d2465cf-5d21-4960-ba02-3a200e888ce2","Type":"ContainerDied","Data":"cba3c414dfa1622441ea50b3a76989354a871836734f1985199345f0d7d48c82"}
Jul 07 16:51:52.888530 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.888506    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:51:52.982684 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.982646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata\") pod \"6d2465cf-5d21-4960-ba02-3a200e888ce2\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") "
Jul 07 16:51:52.982684 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.982687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlzbh\" (UniqueName: \"kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh\") pod \"6d2465cf-5d21-4960-ba02-3a200e888ce2\" (UID: \"6d2465cf-5d21-4960-ba02-3a200e888ce2\") "
Jul 07 16:51:52.984959 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:52.984924    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh" (OuterVolumeSpecName: "kube-api-access-hlzbh") pod "6d2465cf-5d21-4960-ba02-3a200e888ce2" (UID: "6d2465cf-5d21-4960-ba02-3a200e888ce2"). InnerVolumeSpecName "kube-api-access-hlzbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:51:53.013646 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.013606    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "6d2465cf-5d21-4960-ba02-3a200e888ce2" (UID: "6d2465cf-5d21-4960-ba02-3a200e888ce2"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:53.083952 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.083919    2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6d2465cf-5d21-4960-ba02-3a200e888ce2-postgresdata\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:51:53.083952 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.083948    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlzbh\" (UniqueName: \"kubernetes.io/projected/6d2465cf-5d21-4960-ba02-3a200e888ce2-kube-api-access-hlzbh\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:51:53.846613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.846584    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8pnv7"
Jul 07 16:51:53.846613 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.846605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8pnv7" event={"ID":"6d2465cf-5d21-4960-ba02-3a200e888ce2","Type":"ContainerDied","Data":"20c0439538c8687f4f1b59162d226c2512a8652f5b51e7dd39e629111384fb15"}
Jul 07 16:51:53.847204 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.846653    2565 scope.go:117] "RemoveContainer" containerID="cba3c414dfa1622441ea50b3a76989354a871836734f1985199345f0d7d48c82"
Jul 07 16:51:53.849868 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.849847    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerID="e3d517742ef881f1f775a964ac6221bf8bf9d063cd54ed12e8b3bbda0eb3db7b" exitCode=0
Jul 07 16:51:53.849970 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.849879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"e3d517742ef881f1f775a964ac6221bf8bf9d063cd54ed12e8b3bbda0eb3db7b"}
Jul 07 16:51:53.865295 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.865273    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:51:53.868743 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:53.868723    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8pnv7"]
Jul 07 16:51:55.497267 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:51:55.497235    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d2465cf-5d21-4960-ba02-3a200e888ce2" path="/var/lib/kubelet/pods/6d2465cf-5d21-4960-ba02-3a200e888ce2/volumes"
Jul 07 16:52:02.550156 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:02.550113    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 07 16:52:12.549910 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:12.549865    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 07 16:52:22.549365 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.549322    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 07 16:52:22.549807 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.549455    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:52:22.965773 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.965738    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerID="24e209a4b227ed0ed010180c53750d4421c68e0309582ac2099799942fff0184" exitCode=137
Jul 07 16:52:22.965773 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.965763    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerID="2e364c40a06e1f91bc069532d9c892a34dcbab1ac73038d8522c5350f1bf460a" exitCode=137
Jul 07 16:52:22.965993 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.965805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"24e209a4b227ed0ed010180c53750d4421c68e0309582ac2099799942fff0184"}
Jul 07 16:52:22.965993 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:22.965875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"2e364c40a06e1f91bc069532d9c892a34dcbab1ac73038d8522c5350f1bf460a"}
Jul 07 16:52:23.267029 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.266999    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:52:23.430897 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.430851    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls\") pod \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") "
Jul 07 16:52:23.431102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.430943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") pod \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") "
Jul 07 16:52:23.431102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.430972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28zwb\" (UniqueName: \"kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb\") pod \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") "
Jul 07 16:52:23.431102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.431037    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data\") pod \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") "
Jul 07 16:52:23.431102 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.431065    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") pod \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\" (UID: \"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9\") "
Jul 07 16:52:23.432999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.432975    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:23.433129 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.433106    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:23.433176 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.433132    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls" (OuterVolumeSpecName: "online-tls") pod "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:23.433539 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.433516    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb" (OuterVolumeSpecName: "kube-api-access-28zwb") pod "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9"). InnerVolumeSpecName "kube-api-access-28zwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:23.439391 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.439365    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data" (OuterVolumeSpecName: "feast-data") pod "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" (UID: "2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:23.532043 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.532019    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:52:23.532043 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.532041    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:52:23.532198 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.532049    2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-offline-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:52:23.532198 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.532058    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28zwb\" (UniqueName: \"kubernetes.io/projected/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-kube-api-access-28zwb\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:52:23.532198 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.532066    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:52:23.978864 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.978793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b" event={"ID":"2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9","Type":"ContainerDied","Data":"290fd5dccf913587a9585dad9e8e2d178bd760cf8ce97795ebbf4eb54a0a8bae"}
Jul 07 16:52:23.979352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.978871    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"
Jul 07 16:52:23.979352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.978955    2565 scope.go:117] "RemoveContainer" containerID="24e209a4b227ed0ed010180c53750d4421c68e0309582ac2099799942fff0184"
Jul 07 16:52:23.987692 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.987672    2565 scope.go:117] "RemoveContainer" containerID="e3d517742ef881f1f775a964ac6221bf8bf9d063cd54ed12e8b3bbda0eb3db7b"
Jul 07 16:52:23.995528 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:23.995509    2565 scope.go:117] "RemoveContainer" containerID="2e364c40a06e1f91bc069532d9c892a34dcbab1ac73038d8522c5350f1bf460a"
Jul 07 16:52:24.001053 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:24.001025    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:52:24.004543 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:24.004502    2565 scope.go:117] "RemoveContainer" containerID="85361bbdec63cf6b7a183e8a857f2b438e00cc6b795d7808729f0c350c6e3f95"
Jul 07 16:52:24.005312 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:24.005292    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6c47b54cb9-nss2b"]
Jul 07 16:52:24.011642 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:24.011625    2565 scope.go:117] "RemoveContainer" containerID="ce4903a214e8b48af9b0f04c4d4894d6bda67e22188adf8fa23c35264dee83a5"
Jul 07 16:52:25.496772 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:25.496737    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" path="/var/lib/kubelet/pods/2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9/volumes"
Jul 07 16:52:30.200034 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:30.199995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:30.300085 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:30.300051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:30.506503 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:30.506415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:30.606970 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:30.606933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:30.818322 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:52:30.818224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:06.885481 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:06.885399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:06.973317 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:06.973289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:13.392262 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:13.392230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:54:13.394020 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:13.394000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:54:52.412966 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.412930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:52.584872 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.584843    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:54:52.585168 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585156    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d2465cf-5d21-4960-ba02-3a200e888ce2" containerName="postgres"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585170    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d2465cf-5d21-4960-ba02-3a200e888ce2" containerName="postgres"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585184    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="feast-init"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585189    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="feast-init"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585197    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585205    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry"
Jul 07 16:54:52.585213 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585215    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="offline"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585221    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="offline"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="feast-apply"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585235    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="feast-apply"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585262    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585267    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585324    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d2465cf-5d21-4960-ba02-3a200e888ce2" containerName="postgres"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585332    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="registry"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585338    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="online"
Jul 07 16:54:52.585408 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.585343    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4a97a9-51a1-402f-9beb-f5bcc7f87ec9" containerName="offline"
Jul 07 16:54:52.588194 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.588176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:54:52.591118 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.591098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-82tj5\""
Jul 07 16:54:52.591396 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.591380    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 07 16:54:52.592449 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.592431    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 07 16:54:52.604744 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.604718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:54:52.633333 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.633309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhgf9\" (UniqueName: \"kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9\") pod \"redis-69bbd798b6-z48k6\" (UID: \"190b4819-6b03-4d25-9da4-becf73f956f7\") " pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:54:52.734519 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.734439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhgf9\" (UniqueName: \"kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9\") pod \"redis-69bbd798b6-z48k6\" (UID: \"190b4819-6b03-4d25-9da4-becf73f956f7\") " pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:54:52.743746 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.743719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhgf9\" (UniqueName: \"kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9\") pod \"redis-69bbd798b6-z48k6\" (UID: \"190b4819-6b03-4d25-9da4-becf73f956f7\") " pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:54:52.914687 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:52.914659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:54:53.043547 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:53.043524    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:54:53.045756 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:54:53.045732    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod190b4819_6b03_4d25_9da4_becf73f956f7.slice/crio-6c9002ecaefdec3d53355e1eb577f4204a426e3056788145452409628d1a4872 WatchSource:0}: Error finding container 6c9002ecaefdec3d53355e1eb577f4204a426e3056788145452409628d1a4872: Status 404 returned error can't find the container with id 6c9002ecaefdec3d53355e1eb577f4204a426e3056788145452409628d1a4872
Jul 07 16:54:53.563368 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:53.563331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" event={"ID":"190b4819-6b03-4d25-9da4-becf73f956f7","Type":"ContainerStarted","Data":"6c9002ecaefdec3d53355e1eb577f4204a426e3056788145452409628d1a4872"}
Jul 07 16:54:53.583390 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:53.583360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:55.573851 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:55.573798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" event={"ID":"190b4819-6b03-4d25-9da4-becf73f956f7","Type":"ContainerStarted","Data":"6f223345990d9b253dabb27aa27ee769b06b2760d324a93dee89431be9b69d92"}
Jul 07 16:54:55.591734 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:55.591683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" podStartSLOduration=2.025602726 podStartE2EDuration="3.59166798s" totalImagesPullingTime="1.566065254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:54:55.589758267 +0000 UTC m=+942.595324495" watchObservedRunningTime="2026-07-07 16:54:55.59166798 +0000 UTC m=+942.597234185"
Jul 07 16:54:58.024441 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.024407    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:54:58.028260 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.028236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.030899 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.030875    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 07 16:54:58.034243 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.034222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:54:58.058428 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.058403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:58.080541 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.080511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgp8h\" (UniqueName: \"kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.080666 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.080571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.181400 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.181367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.181569 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.181426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgp8h\" (UniqueName: \"kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.181748 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.181728    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.191091 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.191065    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgp8h\" (UniqueName: \"kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h\") pod \"postgres-864846d4f5-w5bf8\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") " pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.338977 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.338898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:54:58.465253 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.465221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:54:58.468678 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:54:58.468645    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ce26d95_5f22_47a7_a26c_275a0b69b540.slice/crio-c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1 WatchSource:0}: Error finding container c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1: Status 404 returned error can't find the container with id c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1
Jul 07 16:54:58.588088 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.588052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" event={"ID":"6ce26d95-5f22-47a7-a26c-275a0b69b540","Type":"ContainerStarted","Data":"85d7afc1ca5db8970cbe046f283811ba73730c52a3a96f2b2e6abdc333fe9e2c"}
Jul 07 16:54:58.588088 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.588095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" event={"ID":"6ce26d95-5f22-47a7-a26c-275a0b69b540","Type":"ContainerStarted","Data":"c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1"}
Jul 07 16:54:58.607462 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:54:58.607365    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" podStartSLOduration=0.607345253 podStartE2EDuration="607.345253ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:54:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:54:58.605399448 +0000 UTC m=+945.610965659" watchObservedRunningTime="2026-07-07 16:54:58.607345253 +0000 UTC m=+945.612911464"
Jul 07 16:55:03.494446 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.494410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:03.564965 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.564933    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:55:03.568308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.568289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.571538 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.571512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-tb692\""
Jul 07 16:55:03.571665 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.571640    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 07 16:55:03.571782 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.571763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 07 16:55:03.572172 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.572153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 07 16:55:03.582873 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.582851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:55:03.590794 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.590774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:03.627437 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.627411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.627556 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.627528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.627600 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.627572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmpx9\" (UniqueName: \"kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.627653 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.627599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.698192 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.698159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:03.728690 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.728665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.728801 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.728705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.728801 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.728722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmpx9\" (UniqueName: \"kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.728801 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.728742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.728953 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:55:03.728840    2565 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jul 07 16:55:03.728953 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:55:03.728908    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls podName:6c178831-9a12-4c40-82cc-f07c651faa62 nodeName:}" failed. No retries permitted until 2026-07-07 16:55:04.228885128 +0000 UTC m=+951.234451315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls") pod "feast-credit-scoring-8c59cd7fc-jb5dz" (UID: "6c178831-9a12-4c40-82cc-f07c651faa62") : secret "feast-credit-scoring-online-tls" not found
Jul 07 16:55:03.729151 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.729136    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.731142 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.731125    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.738079 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.738056    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmpx9\" (UniqueName: \"kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:03.818005 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:03.817911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:04.234095 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:04.234057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:04.236421 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:04.236401    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") pod \"feast-credit-scoring-8c59cd7fc-jb5dz\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") " pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:04.482191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:04.482154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:04.616893 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:04.616869    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:55:04.618351 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:55:04.618330    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c178831_9a12_4c40_82cc_f07c651faa62.slice/crio-7c82da98b82fdf2ec1f4178a640f6f334087fac333458a5a109601a7b5fa9768 WatchSource:0}: Error finding container 7c82da98b82fdf2ec1f4178a640f6f334087fac333458a5a109601a7b5fa9768: Status 404 returned error can't find the container with id 7c82da98b82fdf2ec1f4178a640f6f334087fac333458a5a109601a7b5fa9768
Jul 07 16:55:05.616028 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:05.615992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerStarted","Data":"595c25c99a7b8f204b5839edd8ba2557b5f88aa92fd146ea56007e9ae7ecf34d"}
Jul 07 16:55:05.616221 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:05.616048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerStarted","Data":"7c82da98b82fdf2ec1f4178a640f6f334087fac333458a5a109601a7b5fa9768"}
Jul 07 16:55:06.621360 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:06.621322    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c178831-9a12-4c40-82cc-f07c651faa62" containerID="595c25c99a7b8f204b5839edd8ba2557b5f88aa92fd146ea56007e9ae7ecf34d" exitCode=0
Jul 07 16:55:06.621794 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:06.621411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerDied","Data":"595c25c99a7b8f204b5839edd8ba2557b5f88aa92fd146ea56007e9ae7ecf34d"}
Jul 07 16:55:07.627618 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:07.627577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerStarted","Data":"38483991d5942ec9e3c087f937c621c21f39dddffae41b26934570cd8129e3bd"}
Jul 07 16:55:13.652460 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:13.652423    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c178831-9a12-4c40-82cc-f07c651faa62" containerID="38483991d5942ec9e3c087f937c621c21f39dddffae41b26934570cd8129e3bd" exitCode=0
Jul 07 16:55:13.652941 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:13.652472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerDied","Data":"38483991d5942ec9e3c087f937c621c21f39dddffae41b26934570cd8129e3bd"}
Jul 07 16:55:13.656355 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:13.656337    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 07 16:55:14.659629 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:14.659597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerStarted","Data":"9d0642f9d60c58d5925b40c868c14ff1690cfdd2b0214523b673eb2ec7c2d915"}
Jul 07 16:55:14.660069 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:14.659653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerStarted","Data":"048c5e32ea66edfdb03c6c9b3586a5e703be28568e32826a5b0a888507a0da26"}
Jul 07 16:55:14.684967 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:14.684916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podStartSLOduration=11.684899736 podStartE2EDuration="11.684899736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:14.68227181 +0000 UTC m=+961.687838017" watchObservedRunningTime="2026-07-07 16:55:14.684899736 +0000 UTC m=+961.690465944"
Jul 07 16:55:16.482783 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:16.482746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:16.483286 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:16.482840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:16.484347 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:16.484310    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 07 16:55:16.484466 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:16.484341    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 07 16:55:19.483941 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:19.483893    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 07 16:55:19.881429 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:19.881398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:19.881852 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:19.881825    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:19.885771 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:19.885750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:22.483156 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:22.483112    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 07 16:55:24.482697 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:24.482652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:25.483977 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:25.483947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:25.484642 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:25.484625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:55:25.739913 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:25.739794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:29.297843 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.297778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:29.372203 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.372168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:29.376558 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.376534    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:55:29.381591 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.381573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.385224 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.385204    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 07 16:55:29.385620 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.385596    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 07 16:55:29.385800 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.385780    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 07 16:55:29.385895 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.385792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-7bfdv\""
Jul 07 16:55:29.395375 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.395347    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:55:29.475749 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.475713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:29.555766 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.555672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.555766 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.555712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m4q\" (UniqueName: \"kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.555766 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.555733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.556031 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.555839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.627642 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.627612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:29.656849 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.656790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.657025 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.656873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m4q\" (UniqueName: \"kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.657025 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.656904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.657025 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.656935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.657329 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.657310    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.659376 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.659348    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.659583 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.659561    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.665984 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.665959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m4q\" (UniqueName: \"kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q\") pod \"feast-driver-ranking-79dd7fbcc4-4cpf4\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") " pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.694294 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.694267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:29.826185 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:29.826077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:55:29.828340 ip-10-0-128-52 kubenswrapper[2565]: W0707 16:55:29.828308    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeed6106_0ee0_4d26_b526_e101e54e3cfe.slice/crio-ce52508b887184ec13090fc67555d34c8cee3b1ffdc1a7c389e7fdaf09315a32 WatchSource:0}: Error finding container ce52508b887184ec13090fc67555d34c8cee3b1ffdc1a7c389e7fdaf09315a32: Status 404 returned error can't find the container with id ce52508b887184ec13090fc67555d34c8cee3b1ffdc1a7c389e7fdaf09315a32
Jul 07 16:55:30.738685 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:30.738647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerStarted","Data":"3549d3971d2293e5706d70116b3e115b8be797675ffa333cf53ad81a0c4fd48e"}
Jul 07 16:55:30.739111 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:30.738706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerStarted","Data":"ce52508b887184ec13090fc67555d34c8cee3b1ffdc1a7c389e7fdaf09315a32"}
Jul 07 16:55:34.757621 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:34.757588    2565 generic.go:356] "Generic (PLEG): container finished" podID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerID="3549d3971d2293e5706d70116b3e115b8be797675ffa333cf53ad81a0c4fd48e" exitCode=0
Jul 07 16:55:34.758043 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:34.757636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerDied","Data":"3549d3971d2293e5706d70116b3e115b8be797675ffa333cf53ad81a0c4fd48e"}
Jul 07 16:55:35.763918 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:35.763841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerStarted","Data":"264943f5a234729b86a10fc86d050208fcaa3f9f1c66be10a23c74cc5a127553"}
Jul 07 16:55:41.791867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:41.791750    2565 generic.go:356] "Generic (PLEG): container finished" podID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerID="264943f5a234729b86a10fc86d050208fcaa3f9f1c66be10a23c74cc5a127553" exitCode=0
Jul 07 16:55:41.791867 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:41.791846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerDied","Data":"264943f5a234729b86a10fc86d050208fcaa3f9f1c66be10a23c74cc5a127553"}
Jul 07 16:55:42.799112 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:42.799080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerStarted","Data":"2ebaad255a89dbc2b17552a31afecb70b594f8a4fc0100dafe5239fe23332ff1"}
Jul 07 16:55:42.799493 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:42.799132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerStarted","Data":"40f2c370a82d24735d0a0887d193162df1daa3007a7ce2d1fd1d6db1c7d40687"}
Jul 07 16:55:42.825160 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:42.825101    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podStartSLOduration=13.825084068 podStartE2EDuration="13.825084068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:42.822949755 +0000 UTC m=+989.828515989" watchObservedRunningTime="2026-07-07 16:55:42.825084068 +0000 UTC m=+989.830650275"
Jul 07 16:55:44.695338 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:44.695297    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:44.695703 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:44.695376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:44.697149 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:44.697121    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 07 16:55:44.697285 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:44.697152    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 07 16:55:47.695309 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:47.695253    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 07 16:55:48.018222 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:48.018134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:48.018721 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:48.018698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:48.021574 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:48.021551    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:49.695088 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:49.695046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:50.694999 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:50.694958    2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jul 07 16:55:53.695440 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:53.695412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:55:53.696127 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:55:53.696108    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:57:05.992371 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:05.992288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:08.111049 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.111006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:08.470242 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.470207    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:57:08.470477 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.470452    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" podUID="b07aa603-3471-4742-ae66-73fddb09872f" containerName="manager" containerID="cri-o://1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c" gracePeriod=10
Jul 07 16:57:08.491189 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.491160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:08.717494 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.717463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:08.739435 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.739404    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:57:08.797571 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.797538    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:57:08.797775 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.797748    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry" containerID="cri-o://048c5e32ea66edfdb03c6c9b3586a5e703be28568e32826a5b0a888507a0da26" gracePeriod=30
Jul 07 16:57:08.797933 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.797782    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online" containerID="cri-o://9d0642f9d60c58d5925b40c868c14ff1690cfdd2b0214523b673eb2ec7c2d915" gracePeriod=30
Jul 07 16:57:08.827623 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.827592    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:57:08.827848 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.827822    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry" containerID="cri-o://40f2c370a82d24735d0a0887d193162df1daa3007a7ce2d1fd1d6db1c7d40687" gracePeriod=30
Jul 07 16:57:08.827928 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.827866    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online" containerID="cri-o://2ebaad255a89dbc2b17552a31afecb70b594f8a4fc0100dafe5239fe23332ff1" gracePeriod=30
Jul 07 16:57:08.842023 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.841986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:08.896798 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.896769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5jfp\" (UniqueName: \"kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp\") pod \"b07aa603-3471-4742-ae66-73fddb09872f\" (UID: \"b07aa603-3471-4742-ae66-73fddb09872f\") "
Jul 07 16:57:08.898949 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.898924    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp" (OuterVolumeSpecName: "kube-api-access-k5jfp") pod "b07aa603-3471-4742-ae66-73fddb09872f" (UID: "b07aa603-3471-4742-ae66-73fddb09872f"). InnerVolumeSpecName "kube-api-access-k5jfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:08.997505 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:08.997421    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5jfp\" (UniqueName: \"kubernetes.io/projected/b07aa603-3471-4742-ae66-73fddb09872f-kube-api-access-k5jfp\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:09.178389 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.178347    2565 generic.go:356] "Generic (PLEG): container finished" podID="b07aa603-3471-4742-ae66-73fddb09872f" containerID="1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c" exitCode=0
Jul 07 16:57:09.178879 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.178444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"
Jul 07 16:57:09.178879 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.178488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" event={"ID":"b07aa603-3471-4742-ae66-73fddb09872f","Type":"ContainerDied","Data":"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"}
Jul 07 16:57:09.178879 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.178548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt" event={"ID":"b07aa603-3471-4742-ae66-73fddb09872f","Type":"ContainerDied","Data":"abcb105411d5d9e151494c62dc1a330dfbee2697e4deddb478f5d4bb31d4cb1a"}
Jul 07 16:57:09.178879 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.178582    2565 scope.go:117] "RemoveContainer" containerID="1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"
Jul 07 16:57:09.193781 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.193723    2565 scope.go:117] "RemoveContainer" containerID="1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"
Jul 07 16:57:09.194367 ip-10-0-128-52 kubenswrapper[2565]: E0707 16:57:09.194229    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c\": container with ID starting with 1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c not found: ID does not exist" containerID="1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"
Jul 07 16:57:09.194532 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.194499    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c"} err="failed to get container status \"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c\": rpc error: code = NotFound desc = could not find container \"1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c\": container with ID starting with 1a30a8cee692df41408571875fe9551cea91707908d06f72e073c5842a5b0c6c not found: ID does not exist"
Jul 07 16:57:09.209248 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.209220    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:57:09.213323 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.213287    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5cd6c559d5-88cvt"]
Jul 07 16:57:09.499051 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.499007    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b07aa603-3471-4742-ae66-73fddb09872f" path="/var/lib/kubelet/pods/b07aa603-3471-4742-ae66-73fddb09872f/volumes"
Jul 07 16:57:09.882057 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:09.882017    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 07 16:57:10.185151 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.185068    2565 generic.go:356] "Generic (PLEG): container finished" podID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerID="2ebaad255a89dbc2b17552a31afecb70b594f8a4fc0100dafe5239fe23332ff1" exitCode=0
Jul 07 16:57:10.185523 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.185153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerDied","Data":"2ebaad255a89dbc2b17552a31afecb70b594f8a4fc0100dafe5239fe23332ff1"}
Jul 07 16:57:10.187359 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.187341    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c178831-9a12-4c40-82cc-f07c651faa62" containerID="9d0642f9d60c58d5925b40c868c14ff1690cfdd2b0214523b673eb2ec7c2d915" exitCode=0
Jul 07 16:57:10.187437 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.187416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerDied","Data":"9d0642f9d60c58d5925b40c868c14ff1690cfdd2b0214523b673eb2ec7c2d915"}
Jul 07 16:57:10.944732 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.944698    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:57:10.944954 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.944882    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" podUID="6ce26d95-5f22-47a7-a26c-275a0b69b540" containerName="postgres" containerID="cri-o://85d7afc1ca5db8970cbe046f283811ba73730c52a3a96f2b2e6abdc333fe9e2c" gracePeriod=30
Jul 07 16:57:10.951532 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.951504    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:57:10.951720 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:10.951696    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" podUID="190b4819-6b03-4d25-9da4-becf73f956f7" containerName="redis" containerID="cri-o://6f223345990d9b253dabb27aa27ee769b06b2760d324a93dee89431be9b69d92" gracePeriod=30
Jul 07 16:57:11.011943 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.011917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:11.195316 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.195245    2565 generic.go:356] "Generic (PLEG): container finished" podID="6ce26d95-5f22-47a7-a26c-275a0b69b540" containerID="85d7afc1ca5db8970cbe046f283811ba73730c52a3a96f2b2e6abdc333fe9e2c" exitCode=0
Jul 07 16:57:11.195717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.195338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" event={"ID":"6ce26d95-5f22-47a7-a26c-275a0b69b540","Type":"ContainerDied","Data":"85d7afc1ca5db8970cbe046f283811ba73730c52a3a96f2b2e6abdc333fe9e2c"}
Jul 07 16:57:11.195717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.195386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8" event={"ID":"6ce26d95-5f22-47a7-a26c-275a0b69b540","Type":"ContainerDied","Data":"c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1"}
Jul 07 16:57:11.195717 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.195405    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6227dda6fae6b8210957b682ce2849ff6efd78e9acada8085cdfee702306bf1"
Jul 07 16:57:11.197176 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.197152    2565 generic.go:356] "Generic (PLEG): container finished" podID="190b4819-6b03-4d25-9da4-becf73f956f7" containerID="6f223345990d9b253dabb27aa27ee769b06b2760d324a93dee89431be9b69d92" exitCode=0
Jul 07 16:57:11.197279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.197218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" event={"ID":"190b4819-6b03-4d25-9da4-becf73f956f7","Type":"ContainerDied","Data":"6f223345990d9b253dabb27aa27ee769b06b2760d324a93dee89431be9b69d92"}
Jul 07 16:57:11.213878 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.213859    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:57:11.216965 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.216948    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:57:11.317325 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.317295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhgf9\" (UniqueName: \"kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9\") pod \"190b4819-6b03-4d25-9da4-becf73f956f7\" (UID: \"190b4819-6b03-4d25-9da4-becf73f956f7\") "
Jul 07 16:57:11.317518 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.317374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata\") pod \"6ce26d95-5f22-47a7-a26c-275a0b69b540\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") "
Jul 07 16:57:11.317518 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.317413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgp8h\" (UniqueName: \"kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h\") pod \"6ce26d95-5f22-47a7-a26c-275a0b69b540\" (UID: \"6ce26d95-5f22-47a7-a26c-275a0b69b540\") "
Jul 07 16:57:11.319564 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.319527    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9" (OuterVolumeSpecName: "kube-api-access-dhgf9") pod "190b4819-6b03-4d25-9da4-becf73f956f7" (UID: "190b4819-6b03-4d25-9da4-becf73f956f7"). InnerVolumeSpecName "kube-api-access-dhgf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:11.319670 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.319532    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h" (OuterVolumeSpecName: "kube-api-access-dgp8h") pod "6ce26d95-5f22-47a7-a26c-275a0b69b540" (UID: "6ce26d95-5f22-47a7-a26c-275a0b69b540"). InnerVolumeSpecName "kube-api-access-dgp8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:11.346887 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.346799    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "6ce26d95-5f22-47a7-a26c-275a0b69b540" (UID: "6ce26d95-5f22-47a7-a26c-275a0b69b540"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:11.417958 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.417925    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhgf9\" (UniqueName: \"kubernetes.io/projected/190b4819-6b03-4d25-9da4-becf73f956f7-kube-api-access-dhgf9\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:11.417958 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.417952    2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/6ce26d95-5f22-47a7-a26c-275a0b69b540-postgresdata\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:11.417958 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:11.417961    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgp8h\" (UniqueName: \"kubernetes.io/projected/6ce26d95-5f22-47a7-a26c-275a0b69b540-kube-api-access-dgp8h\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:12.202834 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.202791    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6"
Jul 07 16:57:12.203285 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.202835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-z48k6" event={"ID":"190b4819-6b03-4d25-9da4-becf73f956f7","Type":"ContainerDied","Data":"6c9002ecaefdec3d53355e1eb577f4204a426e3056788145452409628d1a4872"}
Jul 07 16:57:12.203285 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.202882    2565 scope.go:117] "RemoveContainer" containerID="6f223345990d9b253dabb27aa27ee769b06b2760d324a93dee89431be9b69d92"
Jul 07 16:57:12.203285 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.203027    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-w5bf8"
Jul 07 16:57:12.222854 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.222828    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:57:12.224878 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.224858    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-z48k6"]
Jul 07 16:57:12.241334 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.241316    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:57:12.242601 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:12.242582    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-w5bf8"]
Jul 07 16:57:13.497289 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:13.497250    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190b4819-6b03-4d25-9da4-becf73f956f7" path="/var/lib/kubelet/pods/190b4819-6b03-4d25-9da4-becf73f956f7/volumes"
Jul 07 16:57:13.497677 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:13.497588    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce26d95-5f22-47a7-a26c-275a0b69b540" path="/var/lib/kubelet/pods/6ce26d95-5f22-47a7-a26c-275a0b69b540/volumes"
Jul 07 16:57:13.653278 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:13.653241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:13.715806 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:13.715732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:18.019331 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:18.019294    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 07 16:57:19.359277 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:19.359230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:19.422595 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:19.422563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:19.856909 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:19.856872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:19.882537 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:19.882501    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 07 16:57:28.018825 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:28.018776    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 07 16:57:29.882956 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:29.882915    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 07 16:57:29.883353 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:29.883044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:57:34.088193 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.088159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.188569 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.188539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.511165 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.511122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.614558 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.614528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.736908 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.736878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.838042 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.837961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:34.937558 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:34.937525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:35.252987 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:35.252958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:38.019308 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:38.019270    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 07 16:57:38.019776 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:38.019395    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:57:39.318987 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.318959    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c178831-9a12-4c40-82cc-f07c651faa62" containerID="048c5e32ea66edfdb03c6c9b3586a5e703be28568e32826a5b0a888507a0da26" exitCode=137
Jul 07 16:57:39.319347 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.319030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerDied","Data":"048c5e32ea66edfdb03c6c9b3586a5e703be28568e32826a5b0a888507a0da26"}
Jul 07 16:57:39.321280 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.321260    2565 generic.go:356] "Generic (PLEG): container finished" podID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerID="40f2c370a82d24735d0a0887d193162df1daa3007a7ce2d1fd1d6db1c7d40687" exitCode=137
Jul 07 16:57:39.321381 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.321297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerDied","Data":"40f2c370a82d24735d0a0887d193162df1daa3007a7ce2d1fd1d6db1c7d40687"}
Jul 07 16:57:39.456974 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.456947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:57:39.479285 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.479262    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:57:39.544364 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") pod \"6c178831-9a12-4c40-82cc-f07c651faa62\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") "
Jul 07 16:57:39.544549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmpx9\" (UniqueName: \"kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9\") pod \"6c178831-9a12-4c40-82cc-f07c651faa62\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") "
Jul 07 16:57:39.544549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data\") pod \"beed6106-0ee0-4d26-b526-e101e54e3cfe\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") "
Jul 07 16:57:39.544549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls\") pod \"beed6106-0ee0-4d26-b526-e101e54e3cfe\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") "
Jul 07 16:57:39.544549 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls\") pod \"beed6106-0ee0-4d26-b526-e101e54e3cfe\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") "
Jul 07 16:57:39.544779 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7m4q\" (UniqueName: \"kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q\") pod \"beed6106-0ee0-4d26-b526-e101e54e3cfe\" (UID: \"beed6106-0ee0-4d26-b526-e101e54e3cfe\") "
Jul 07 16:57:39.544779 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls\") pod \"6c178831-9a12-4c40-82cc-f07c651faa62\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") "
Jul 07 16:57:39.544988 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.544960    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data" (OuterVolumeSpecName: "feast-data") pod "beed6106-0ee0-4d26-b526-e101e54e3cfe" (UID: "beed6106-0ee0-4d26-b526-e101e54e3cfe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:39.546671 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.545094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data\") pod \"6c178831-9a12-4c40-82cc-f07c651faa62\" (UID: \"6c178831-9a12-4c40-82cc-f07c651faa62\") "
Jul 07 16:57:39.546671 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.545351    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/beed6106-0ee0-4d26-b526-e101e54e3cfe-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.547275 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547246    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "beed6106-0ee0-4d26-b526-e101e54e3cfe" (UID: "beed6106-0ee0-4d26-b526-e101e54e3cfe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:39.547275 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547260    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q" (OuterVolumeSpecName: "kube-api-access-g7m4q") pod "beed6106-0ee0-4d26-b526-e101e54e3cfe" (UID: "beed6106-0ee0-4d26-b526-e101e54e3cfe"). InnerVolumeSpecName "kube-api-access-g7m4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:39.547412 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547268    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls" (OuterVolumeSpecName: "online-tls") pod "beed6106-0ee0-4d26-b526-e101e54e3cfe" (UID: "beed6106-0ee0-4d26-b526-e101e54e3cfe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:39.547412 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547300    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6c178831-9a12-4c40-82cc-f07c651faa62" (UID: "6c178831-9a12-4c40-82cc-f07c651faa62"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:39.547412 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547313    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls" (OuterVolumeSpecName: "online-tls") pod "6c178831-9a12-4c40-82cc-f07c651faa62" (UID: "6c178831-9a12-4c40-82cc-f07c651faa62"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:39.547412 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.547329    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9" (OuterVolumeSpecName: "kube-api-access-qmpx9") pod "6c178831-9a12-4c40-82cc-f07c651faa62" (UID: "6c178831-9a12-4c40-82cc-f07c651faa62"). InnerVolumeSpecName "kube-api-access-qmpx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:39.555080 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.555057    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data" (OuterVolumeSpecName: "feast-data") pod "6c178831-9a12-4c40-82cc-f07c651faa62" (UID: "6c178831-9a12-4c40-82cc-f07c651faa62"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:39.645904 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645876    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.645904 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645905    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7m4q\" (UniqueName: \"kubernetes.io/projected/beed6106-0ee0-4d26-b526-e101e54e3cfe-kube-api-access-g7m4q\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.646070 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645915    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-registry-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.646070 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645923    2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6c178831-9a12-4c40-82cc-f07c651faa62-feast-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.646070 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645932    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6c178831-9a12-4c40-82cc-f07c651faa62-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.646070 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645939    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmpx9\" (UniqueName: \"kubernetes.io/projected/6c178831-9a12-4c40-82cc-f07c651faa62-kube-api-access-qmpx9\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:39.646070 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:39.645947    2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/beed6106-0ee0-4d26-b526-e101e54e3cfe-online-tls\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 16:57:40.328314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.328282    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"
Jul 07 16:57:40.328314 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.328299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz" event={"ID":"6c178831-9a12-4c40-82cc-f07c651faa62","Type":"ContainerDied","Data":"7c82da98b82fdf2ec1f4178a640f6f334087fac333458a5a109601a7b5fa9768"}
Jul 07 16:57:40.328890 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.328395    2565 scope.go:117] "RemoveContainer" containerID="9d0642f9d60c58d5925b40c868c14ff1690cfdd2b0214523b673eb2ec7c2d915"
Jul 07 16:57:40.330785 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.330759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4" event={"ID":"beed6106-0ee0-4d26-b526-e101e54e3cfe","Type":"ContainerDied","Data":"ce52508b887184ec13090fc67555d34c8cee3b1ffdc1a7c389e7fdaf09315a32"}
Jul 07 16:57:40.330906 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.330801    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"
Jul 07 16:57:40.337636 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.337617    2565 scope.go:117] "RemoveContainer" containerID="048c5e32ea66edfdb03c6c9b3586a5e703be28568e32826a5b0a888507a0da26"
Jul 07 16:57:40.345645 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.345625    2565 scope.go:117] "RemoveContainer" containerID="38483991d5942ec9e3c087f937c621c21f39dddffae41b26934570cd8129e3bd"
Jul 07 16:57:40.352574 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.352560    2565 scope.go:117] "RemoveContainer" containerID="595c25c99a7b8f204b5839edd8ba2557b5f88aa92fd146ea56007e9ae7ecf34d"
Jul 07 16:57:40.359988 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.359962    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:57:40.360080 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.360001    2565 scope.go:117] "RemoveContainer" containerID="2ebaad255a89dbc2b17552a31afecb70b594f8a4fc0100dafe5239fe23332ff1"
Jul 07 16:57:40.367372 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.367355    2565 scope.go:117] "RemoveContainer" containerID="40f2c370a82d24735d0a0887d193162df1daa3007a7ce2d1fd1d6db1c7d40687"
Jul 07 16:57:40.374464 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.374448    2565 scope.go:117] "RemoveContainer" containerID="264943f5a234729b86a10fc86d050208fcaa3f9f1c66be10a23c74cc5a127553"
Jul 07 16:57:40.377473 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.377452    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c59cd7fc-jb5dz"]
Jul 07 16:57:40.383970 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.383945    2565 scope.go:117] "RemoveContainer" containerID="3549d3971d2293e5706d70116b3e115b8be797675ffa333cf53ad81a0c4fd48e"
Jul 07 16:57:40.398787 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.398765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:57:40.406793 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:40.406771    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-79dd7fbcc4-4cpf4"]
Jul 07 16:57:41.497029 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:41.496999    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" path="/var/lib/kubelet/pods/6c178831-9a12-4c40-82cc-f07c651faa62/volumes"
Jul 07 16:57:41.497503 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:41.497489    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" path="/var/lib/kubelet/pods/beed6106-0ee0-4d26-b526-e101e54e3cfe/volumes"
Jul 07 16:57:48.454465 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:48.454426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:48.516352 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:48.516317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:48.849918 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:57:48.849844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:08.400394 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:58:08.400360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:33.338556 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:58:33.338521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:39.528529 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:58:39.528443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:13.416673 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:13.416646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:59:13.419188 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:13.419168    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 16:59:17.950937 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:17.950903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.051532 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.051497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.175309 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.175278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.276507 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.276422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.352191 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.352155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.497887 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.497856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.599279 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.599188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:18.862350 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:18.862266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:34.970374 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:34.970339    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:35.071924 ip-10-0-128-52 kubenswrapper[2565]: I0707 16:59:35.071888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:00:39.755648 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:00:39.755610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:00:41.565421 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:00:41.565383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:01:13.502201 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:01:13.502172    2565 scope.go:117] "RemoveContainer" containerID="85d7afc1ca5db8970cbe046f283811ba73730c52a3a96f2b2e6abdc333fe9e2c"
Jul 07 17:02:01.514616 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:01.514523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:01.574423 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:01.574384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:01.668911 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:01.668878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:01.769109 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:01.769031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:01.827397 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:01.827370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:06.849544 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:06.849507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:29.581216 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:29.581179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:44.478703 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:44.478669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:44.603103 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:44.603074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:50.264100 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:50.264066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:02:50.330297 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:02:50.330260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:09.364134 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:09.364050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:09.577045 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:09.577004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:13.342537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:13.342489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:13.426143 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:13.426107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:13.560803 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:13.560773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:13.664524 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:13.664482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:13.762462 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:13.762417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:26.267317 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:26.267283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:03:39.933582 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:03:39.933526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:13.439743 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:13.439707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 17:04:13.443143 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:13.443111    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 17:04:24.709939 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:24.709899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.166520 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.166427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.264612 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.264584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.380041 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.380010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.481899 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.481802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.559414 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.559385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.731289 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.731255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.869128 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.869097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:04:37.964113 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:04:37.964084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:05:23.020996 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:05:23.020964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:06:02.563944 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:06:02.563902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:06:03.846867 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:06:03.846833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:23.923879 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:23.923842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:23.984271 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:23.984239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:24.070522 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:24.070491    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:24.143495 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:24.143461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:24.204927 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:24.204842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:07:29.248715 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:07:29.248657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:07.183227 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:07.183140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:07.302660 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:07.302628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:13.063715 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.063679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:13.131297 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.131264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:13.460774 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.460737    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nh7gg/must-gather-nfdbv"]
Jul 07 17:08:13.461058 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="feast-init"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461060    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="feast-init"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461070    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="feast-init"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461075    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="feast-init"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461087    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="feast-apply"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461102    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="feast-apply"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461108    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry"
Jul 07 17:08:13.461111 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461113    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461123    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce26d95-5f22-47a7-a26c-275a0b69b540" containerName="postgres"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461128    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce26d95-5f22-47a7-a26c-275a0b69b540" containerName="postgres"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461136    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="feast-apply"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461141    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="feast-apply"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461146    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461151    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461156    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461161    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190b4819-6b03-4d25-9da4-becf73f956f7" containerName="redis"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461173    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="190b4819-6b03-4d25-9da4-becf73f956f7" containerName="redis"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461183    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07aa603-3471-4742-ae66-73fddb09872f" containerName="manager"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461187    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07aa603-3471-4742-ae66-73fddb09872f" containerName="manager"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461232    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="registry"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461239    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="registry"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461246    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="190b4819-6b03-4d25-9da4-becf73f956f7" containerName="redis"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461251    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce26d95-5f22-47a7-a26c-275a0b69b540" containerName="postgres"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461257    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b07aa603-3471-4742-ae66-73fddb09872f" containerName="manager"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461263    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c178831-9a12-4c40-82cc-f07c651faa62" containerName="online"
Jul 07 17:08:13.461415 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.461268    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="beed6106-0ee0-4d26-b526-e101e54e3cfe" containerName="online"
Jul 07 17:08:13.464184 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.464169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.466934 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.466913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nh7gg\"/\"default-dockercfg-4g2l9\""
Jul 07 17:08:13.467085 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.467035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nh7gg\"/\"kube-root-ca.crt\""
Jul 07 17:08:13.467231 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.467206    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nh7gg\"/\"openshift-service-ca.crt\""
Jul 07 17:08:13.472927 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.472902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:13.473801 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.473783    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nh7gg/must-gather-nfdbv"]
Jul 07 17:08:13.534946 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.534917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:13.591546 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.591516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.591546 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.591545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rqrw\" (UniqueName: \"kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.692865 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.692794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.692865 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.692873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rqrw\" (UniqueName: \"kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.693121 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.693098    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.702018 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.701992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rqrw\" (UniqueName: \"kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw\") pod \"must-gather-nfdbv\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") " pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.783969 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.783897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:13.911341 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.911308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nh7gg/must-gather-nfdbv"]
Jul 07 17:08:13.914225 ip-10-0-128-52 kubenswrapper[2565]: W0707 17:08:13.914198    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce286ce3_48d7_4737_86d4_40efc78970ce.slice/crio-4c3cdac98a3840435e3bd4c1467a481bc0a1412e1fc56ce472b57871ee4c085f WatchSource:0}: Error finding container 4c3cdac98a3840435e3bd4c1467a481bc0a1412e1fc56ce472b57871ee4c085f: Status 404 returned error can't find the container with id 4c3cdac98a3840435e3bd4c1467a481bc0a1412e1fc56ce472b57871ee4c085f
Jul 07 17:08:13.916205 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:13.916188    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:08:14.741237 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:14.741203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" event={"ID":"ce286ce3-48d7-4737-86d4-40efc78970ce","Type":"ContainerStarted","Data":"4c3cdac98a3840435e3bd4c1467a481bc0a1412e1fc56ce472b57871ee4c085f"}
Jul 07 17:08:20.771618 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:20.771571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" event={"ID":"ce286ce3-48d7-4737-86d4-40efc78970ce","Type":"ContainerStarted","Data":"d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d"}
Jul 07 17:08:20.771618 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:20.771615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" event={"ID":"ce286ce3-48d7-4737-86d4-40efc78970ce","Type":"ContainerStarted","Data":"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"}
Jul 07 17:08:20.788761 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:20.788698    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" podStartSLOduration=1.438569428 podStartE2EDuration="7.788679719s" totalImagesPullingTime="6.350110291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:20.787525089 +0000 UTC m=+1747.793091321" watchObservedRunningTime="2026-07-07 17:08:20.788679719 +0000 UTC m=+1747.794245927"
Jul 07 17:08:30.815457 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:30.815422    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerID="9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92" exitCode=0
Jul 07 17:08:30.815956 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:30.815478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" event={"ID":"ce286ce3-48d7-4737-86d4-40efc78970ce","Type":"ContainerDied","Data":"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"}
Jul 07 17:08:30.815956 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:30.815771    2565 scope.go:117] "RemoveContainer" containerID="9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"
Jul 07 17:08:30.863051 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:30.863024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nh7gg_must-gather-nfdbv_ce286ce3-48d7-4737-86d4-40efc78970ce/gather/0.log"
Jul 07 17:08:31.206298 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:31.206266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:31.373042 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:31.373013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:31.430923 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:31.430892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:34.232003 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:34.231971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mn7vv_f4214a03-83cb-49df-889b-0e098d963c07/global-pull-secret-syncer/0.log"
Jul 07 17:08:34.336293 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:34.336263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log"
Jul 07 17:08:34.419247 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:34.419223    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-52.ec2.internal_fb5189a869022cef34eed256cb1ca3a3/haproxy/0.log"
Jul 07 17:08:36.174126 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.174091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-nh7gg/must-gather-nfdbv"]
Jul 07 17:08:36.174523 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.174300    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-nh7gg/must-gather-nfdbv" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="copy" containerID="cri-o://d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d" gracePeriod=2
Jul 07 17:08:36.176954 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.176916    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nfdbv\" is forbidden: User \"system:node:ip-10-0-128-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nh7gg\": no relationship found between node 'ip-10-0-128-52.ec2.internal' and this object" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.179370 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.178276    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-nh7gg/must-gather-nfdbv"]
Jul 07 17:08:36.412474 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.412452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nh7gg_must-gather-nfdbv_ce286ce3-48d7-4737-86d4-40efc78970ce/copy/0.log"
Jul 07 17:08:36.414884 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.414867    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.417459 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.417438    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nfdbv\" is forbidden: User \"system:node:ip-10-0-128-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nh7gg\": no relationship found between node 'ip-10-0-128-52.ec2.internal' and this object" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.596414 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.596326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output\") pod \"ce286ce3-48d7-4737-86d4-40efc78970ce\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") "
Jul 07 17:08:36.596414 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.596387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rqrw\" (UniqueName: \"kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw\") pod \"ce286ce3-48d7-4737-86d4-40efc78970ce\" (UID: \"ce286ce3-48d7-4737-86d4-40efc78970ce\") "
Jul 07 17:08:36.596753 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.596722    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "ce286ce3-48d7-4737-86d4-40efc78970ce" (UID: "ce286ce3-48d7-4737-86d4-40efc78970ce"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:08:36.598529 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.598501    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw" (OuterVolumeSpecName: "kube-api-access-5rqrw") pod "ce286ce3-48d7-4737-86d4-40efc78970ce" (UID: "ce286ce3-48d7-4737-86d4-40efc78970ce"). InnerVolumeSpecName "kube-api-access-5rqrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:08:36.671409 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.671381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:36.696864 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.696835    2565 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ce286ce3-48d7-4737-86d4-40efc78970ce-must-gather-output\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 17:08:36.696864 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.696859    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rqrw\" (UniqueName: \"kubernetes.io/projected/ce286ce3-48d7-4737-86d4-40efc78970ce-kube-api-access-5rqrw\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 07 17:08:36.731016 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.730984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mj5d_3d4912db-01db-4831-8a1f-989333dca9c9/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:36.839969 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.839943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-nh7gg_must-gather-nfdbv_ce286ce3-48d7-4737-86d4-40efc78970ce/copy/0.log"
Jul 07 17:08:36.840311 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.840289    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerID="d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d" exitCode=143
Jul 07 17:08:36.840431 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.840350    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.840496 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.840352    2565 scope.go:117] "RemoveContainer" containerID="d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d"
Jul 07 17:08:36.843191 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.843151    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nfdbv\" is forbidden: User \"system:node:ip-10-0-128-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nh7gg\": no relationship found between node 'ip-10-0-128-52.ec2.internal' and this object" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.848759 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.848738    2565 scope.go:117] "RemoveContainer" containerID="9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"
Jul 07 17:08:36.851998 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.851970    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nfdbv\" is forbidden: User \"system:node:ip-10-0-128-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-nh7gg\": no relationship found between node 'ip-10-0-128-52.ec2.internal' and this object" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" pod="openshift-must-gather-nh7gg/must-gather-nfdbv"
Jul 07 17:08:36.860440 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.860423    2565 scope.go:117] "RemoveContainer" containerID="d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d"
Jul 07 17:08:36.860691 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.860672    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d\": container with ID starting with d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d not found: ID does not exist" containerID="d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d"
Jul 07 17:08:36.860739 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.860700    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d"} err="failed to get container status \"d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d\": rpc error: code = NotFound desc = could not find container \"d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d\": container with ID starting with d15cc66cd13574083f2be1c08b166aba500d6d73bf02b5f36999251a156be86d not found: ID does not exist"
Jul 07 17:08:36.860739 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.860718    2565 scope.go:117] "RemoveContainer" containerID="9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"
Jul 07 17:08:36.860957 ip-10-0-128-52 kubenswrapper[2565]: E0707 17:08:36.860938    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92\": container with ID starting with 9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92 not found: ID does not exist" containerID="9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"
Jul 07 17:08:36.861018 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:36.860967    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92"} err="failed to get container status \"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92\": rpc error: code = NotFound desc = could not find container \"9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92\": container with ID starting with 9a4b8290207c4d789c51e3952115f1794d0c8ed72a9574daa8615ce3e407cf92 not found: ID does not exist"
Jul 07 17:08:37.496547 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:37.496516    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" path="/var/lib/kubelet/pods/ce286ce3-48d7-4737-86d4-40efc78970ce/volumes"
Jul 07 17:08:38.122113 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.122084    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pqw88_9ae08890-087b-437c-9b80-892f14c498bb/cluster-monitoring-operator/0.log"
Jul 07 17:08:38.159277 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.159249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2769n_3728832e-a46f-4cd7-9fd3-17fc136d8922/kube-state-metrics/0.log"
Jul 07 17:08:38.192112 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.192090    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2769n_3728832e-a46f-4cd7-9fd3-17fc136d8922/kube-rbac-proxy-main/0.log"
Jul 07 17:08:38.218535 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.218513    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-2769n_3728832e-a46f-4cd7-9fd3-17fc136d8922/kube-rbac-proxy-self/0.log"
Jul 07 17:08:38.291167 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.291138    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-kw2qq_ca9cf030-4c1d-4fea-94ad-4fb7c36a56ff/monitoring-plugin/0.log"
Jul 07 17:08:38.417028 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.416956    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jr2zt_0cc16650-77d5-44c1-92f5-5841f8a6b3cf/node-exporter/0.log"
Jul 07 17:08:38.440175 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.440153    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jr2zt_0cc16650-77d5-44c1-92f5-5841f8a6b3cf/kube-rbac-proxy/0.log"
Jul 07 17:08:38.463377 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:38.463356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jr2zt_0cc16650-77d5-44c1-92f5-5841f8a6b3cf/init-textfile/0.log"
Jul 07 17:08:39.017272 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.017243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/thanos-query/0.log"
Jul 07 17:08:39.046819 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.046796    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/kube-rbac-proxy-web/0.log"
Jul 07 17:08:39.071339 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.071316    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/kube-rbac-proxy/0.log"
Jul 07 17:08:39.099214 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.099192    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/prom-label-proxy/0.log"
Jul 07 17:08:39.126482 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.126459    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/kube-rbac-proxy-rules/0.log"
Jul 07 17:08:39.157427 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:39.157402    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d566f96dc-pk7j5_96c0382c-0b36-44e1-bc5a-4c17513c6690/kube-rbac-proxy-metrics/0.log"
Jul 07 17:08:40.415417 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:40.415388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-ln52p_d999d753-9841-4265-b2c5-ce2d4fb17312/networking-console-plugin/0.log"
Jul 07 17:08:40.860986 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:40.860905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/1.log"
Jul 07 17:08:40.866495 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:40.866479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-x4rpf_9c6cbd48-6b0b-43d1-8fef-47be53512af9/console-operator/2.log"
Jul 07 17:08:41.527146 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527113    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"]
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527409    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="copy"
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527420    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="copy"
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527435    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="gather"
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527441    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="gather"
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527501    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="copy"
Jul 07 17:08:41.527548 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.527510    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce286ce3-48d7-4737-86d4-40efc78970ce" containerName="gather"
Jul 07 17:08:41.532418 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.532397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.535364 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.535341    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbt6x\"/\"kube-root-ca.crt\""
Jul 07 17:08:41.535533 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.535381    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbt6x\"/\"openshift-service-ca.crt\""
Jul 07 17:08:41.536444 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdgd\" (UniqueName: \"kubernetes.io/projected/f5b1e5e0-4c5b-44c3-8494-374edd7da173-kube-api-access-tqdgd\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.536566 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-sys\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.536566 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-proc\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.536566 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-lib-modules\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.536566 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-podres\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.536773 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.536689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xbt6x\"/\"default-dockercfg-4fl5h\""
Jul 07 17:08:41.541432 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.541411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"]
Jul 07 17:08:41.637275 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-proc\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637275 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-lib-modules\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-podres\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637342    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-proc\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637441    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-podres\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdgd\" (UniqueName: \"kubernetes.io/projected/f5b1e5e0-4c5b-44c3-8494-374edd7da173-kube-api-access-tqdgd\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637454    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-lib-modules\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-sys\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.637537 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.637538    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b1e5e0-4c5b-44c3-8494-374edd7da173-sys\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.645975 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.645950    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdgd\" (UniqueName: \"kubernetes.io/projected/f5b1e5e0-4c5b-44c3-8494-374edd7da173-kube-api-access-tqdgd\") pod \"perf-node-gather-daemonset-swcxr\" (UID: \"f5b1e5e0-4c5b-44c3-8494-374edd7da173\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.806341 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.806266    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hkxdz_947dfa27-8b2a-43bc-9041-4b11b9260707/volume-data-source-validator/0.log"
Jul 07 17:08:41.842827 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.842787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:41.970446 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:41.970401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"]
Jul 07 17:08:41.973269 ip-10-0-128-52 kubenswrapper[2565]: W0707 17:08:41.973247    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5b1e5e0_4c5b_44c3_8494_374edd7da173.slice/crio-03875ab0d3549e21e53ec9520d737859c30c1430fefafee58f7db99ca82a6ee8 WatchSource:0}: Error finding container 03875ab0d3549e21e53ec9520d737859c30c1430fefafee58f7db99ca82a6ee8: Status 404 returned error can't find the container with id 03875ab0d3549e21e53ec9520d737859c30c1430fefafee58f7db99ca82a6ee8
Jul 07 17:08:42.578093 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.578062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwq82_e9f7011b-561c-438e-83f6-d9a9c076a92a/dns/0.log"
Jul 07 17:08:42.613290 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.613265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwq82_e9f7011b-561c-438e-83f6-d9a9c076a92a/kube-rbac-proxy/0.log"
Jul 07 17:08:42.717619 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.717589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5f6ts_4292bfec-88b4-4129-b64d-b158026e3d2e/dns-node-resolver/0.log"
Jul 07 17:08:42.867763 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.867732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr" event={"ID":"f5b1e5e0-4c5b-44c3-8494-374edd7da173","Type":"ContainerStarted","Data":"98f601af5b06158d2614e6d30be668f05b519ec2f3c2ade9f216e11dab988bd1"}
Jul 07 17:08:42.867951 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.867781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr" event={"ID":"f5b1e5e0-4c5b-44c3-8494-374edd7da173","Type":"ContainerStarted","Data":"03875ab0d3549e21e53ec9520d737859c30c1430fefafee58f7db99ca82a6ee8"}
Jul 07 17:08:42.867951 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.867864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:42.889050 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:42.889000    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr" podStartSLOduration=1.888986372 podStartE2EDuration="1.888986372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:42.888313705 +0000 UTC m=+1769.893879913" watchObservedRunningTime="2026-07-07 17:08:42.888986372 +0000 UTC m=+1769.894552589"
Jul 07 17:08:43.165143 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:43.165067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6nzd8_c072679b-a7a8-42f0-97df-289ec7399e48/node-ca/0.log"
Jul 07 17:08:43.898983 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:43.898954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56db5cb645-4dpnk_5d11a057-0702-482e-8de5-58ae4048cc56/router/0.log"
Jul 07 17:08:44.212257 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.212181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bpgv_c39885ba-6190-41d6-bf7c-02f0cc147a8e/serve-healthcheck-canary/0.log"
Jul 07 17:08:44.594386 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.594303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8kwr8_b6f211a4-adcc-4101-8ede-164e5ffe1995/insights-operator/0.log"
Jul 07 17:08:44.594776 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.594757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8kwr8_b6f211a4-adcc-4101-8ede-164e5ffe1995/insights-operator/1.log"
Jul 07 17:08:44.764515 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.764486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg78s_eef9ecfc-9e21-49c7-bb62-da0b71e20ffe/kube-rbac-proxy/0.log"
Jul 07 17:08:44.786416 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.786392    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg78s_eef9ecfc-9e21-49c7-bb62-da0b71e20ffe/exporter/0.log"
Jul 07 17:08:44.810443 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:44.810412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg78s_eef9ecfc-9e21-49c7-bb62-da0b71e20ffe/extractor/0.log"
Jul 07 17:08:48.880716 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:48.880691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-swcxr"
Jul 07 17:08:49.198670 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:49.198587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-5fskp_0e016fb5-877d-4765-b8ef-304ff7fc130d/kube-storage-version-migrator-operator/1.log"
Jul 07 17:08:49.199412 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:49.199393    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-5fskp_0e016fb5-877d-4765-b8ef-304ff7fc130d/kube-storage-version-migrator-operator/0.log"
Jul 07 17:08:50.517446 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.517365    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/kube-multus-additional-cni-plugins/0.log"
Jul 07 17:08:50.546543 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.546513    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/egress-router-binary-copy/0.log"
Jul 07 17:08:50.571408 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.571383    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/cni-plugins/0.log"
Jul 07 17:08:50.596396 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.596370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/bond-cni-plugin/0.log"
Jul 07 17:08:50.620251 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.620229    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/routeoverride-cni/0.log"
Jul 07 17:08:50.646303 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.646284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/whereabouts-cni-bincopy/0.log"
Jul 07 17:08:50.669598 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.669575    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppglm_7a8df170-a942-4075-89a1-e83d331f3340/whereabouts-cni/0.log"
Jul 07 17:08:50.761417 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.761389    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vppt7_f60e40fc-f0c8-4262-9036-2ddb4183dce4/kube-multus/0.log"
Jul 07 17:08:50.887238 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.887210    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrp9n_deb5fca9-079a-4da2-9ee3-3230e475257a/network-metrics-daemon/0.log"
Jul 07 17:08:50.912855 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:50.912829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrp9n_deb5fca9-079a-4da2-9ee3-3230e475257a/kube-rbac-proxy/0.log"
Jul 07 17:08:52.070069 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.070037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/ovn-controller/0.log"
Jul 07 17:08:52.089355 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.089266    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/ovn-acl-logging/0.log"
Jul 07 17:08:52.114400 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.114373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/kube-rbac-proxy-node/0.log"
Jul 07 17:08:52.136707 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.136685    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 17:08:52.161422 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.161402    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/northd/0.log"
Jul 07 17:08:52.184377 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.184342    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/nbdb/0.log"
Jul 07 17:08:52.206365 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.206342    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/sbdb/0.log"
Jul 07 17:08:52.249470 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:52.249447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vhccm_5cd4476d-792e-4022-b08e-28f5e8ed3c70/ovnkube-controller/0.log"
Jul 07 17:08:53.162801 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:53.162758    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-hsdkl_f913e403-bc5d-489c-8412-a1df7d683f7c/check-endpoints/0.log"
Jul 07 17:08:53.186560 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:53.186525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-22ddz_db59a98a-0b1f-46c8-877a-035df742efc2/network-check-target-container/0.log"
Jul 07 17:08:54.113358 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:54.113327    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-64mmh_54ac774c-5351-4506-8a2c-b286f114646f/iptables-alerter/0.log"
Jul 07 17:08:54.849740 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:54.849711    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-q7q2j_d48470a9-13cf-44b9-980a-ab629ab33319/tuned/0.log"
Jul 07 17:08:56.662904 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:56.662863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-fkzss_2ef500d3-34a3-4cc6-a911-0d76e73951ca/cluster-samples-operator/0.log"
Jul 07 17:08:56.696756 ip-10-0-128-52 kubenswrapper[2565]: I0707 17:08:56.696731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-fkzss_2ef500d3-34a3-4cc6-a911-0d76e73951ca/cluster-samples-operator-watch/0.log"