Jun 11 21:12:52.132617 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 11 21:12:52.132630 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 11 21:12:52.132637 ip-10-0-133-9 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 11 21:12:52.132890 ip-10-0-133-9 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 11 21:13:01.868962 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 11 21:13:01.868980 ip-10-0-133-9 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f6227a2ea17c48dcab282c785e6e54ad --
Jun 11 21:15:15.326563 ip-10-0-133-9 systemd[1]: Starting Kubernetes Kubelet...
Jun 11 21:15:15.626007 ip-10-0-133-9 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 21:15:15.626007 ip-10-0-133-9 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 11 21:15:15.626007 ip-10-0-133-9 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 21:15:15.626007 ip-10-0-133-9 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 11 21:15:15.626007 ip-10-0-133-9 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 21:15:15.626714 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.626547    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 11 21:15:15.629970 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629951    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.629970 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629969    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629973    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629979    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629983    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629986    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629989    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629992    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629994    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.629997    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630000    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630002    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630005    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630007    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630010    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630012    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630015    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630018    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630021    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630024    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630026    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.630042 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630029    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630032    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630034    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630036    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630039    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630041    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630044    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630047    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630058    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630061    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630064    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630066    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630068    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630072    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630074    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630077    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630079    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630082    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630084    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630086    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.630536 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630089    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630091    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630094    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630097    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630099    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630101    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630104    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630106    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630109    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630112    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630114    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630116    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630120    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630122    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630125    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630127    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630130    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630133    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630137    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630139    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.631020 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630142    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630144    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630146    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630149    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630152    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630154    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630156    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630159    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630161    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630164    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630166    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630168    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630171    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630173    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630175    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630178    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630181    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630183    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630185    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630189    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.631516 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630192    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630195    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630197    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630200    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630203    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630205    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630208    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630212    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630215    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630218    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630222    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630224    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630227    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630229    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630232    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630236    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630239    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630241    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630980    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.632090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630987    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630991    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630994    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.630997    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631000    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631003    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631005    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631008    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631010    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631013    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631015    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631018    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631021    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631024    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631027    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631030    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631033    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631036    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631039    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631042    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.632593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631044    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631047    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631049    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631053    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631056    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631058    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631061    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631064    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631066    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631069    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631071    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631074    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631076    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631079    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631081    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631084    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631086    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631089    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631091    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631094    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.633090 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631096    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631098    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631101    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631103    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631106    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631108    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631111    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631113    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631117    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631119    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631122    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631124    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631127    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631129    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631131    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631134    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631136    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631139    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631141    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631144    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.633593 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631146    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631148    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631151    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631153    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631156    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631159    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631162    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631164    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631167    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631169    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631173    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631176    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631179    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631182    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631185    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631189    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631193    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631197    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631200    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.634093 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631203    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631206    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631210    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631213    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631216    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631219    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631222    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631225    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631228    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631231    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631233    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631236    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631239    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631241    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631244    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631246    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631249    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631269    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631272    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.634571 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631656    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631661    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631664    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631667    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631669    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631672    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631675    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631678    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631681    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631683    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631687    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631690    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631693    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631696    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631699    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631702    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631705    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631707    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631713    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631716    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.635041 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631718    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631721    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631724    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631726    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631729    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631731    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631734    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631737    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631739    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631742    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631744    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631747    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631750    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631752    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631755    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631757    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631759    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631762    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631764    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631766    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.635558 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631769    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631771    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631774    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631776    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631778    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631781    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631784    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631786    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631789    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631791    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631793    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631796    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631798    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631800    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631803    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631805    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631808    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631810    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631813    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631816    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.636051 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631820    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631823    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631825    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631828    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631830    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631833    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631835    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631837    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631840    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631842    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631845    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631847    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631849    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631852    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631854    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631856    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631859    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631861    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631864    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.636579 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631867    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631870    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631872    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631875    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631879    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631882    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631885    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631888    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631891    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631893    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631895    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631898    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631900    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631904    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631907    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631909    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631912    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631914    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631917    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.637077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.631919    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.631992    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.631999    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632005    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632010    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632014    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632017    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632021    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632025    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632028    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632031    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632035    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632038    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632041    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632045    2570 flags.go:64] FLAG: --cgroup-root=""
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632048    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632051    2570 flags.go:64] FLAG: --client-ca-file=""
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632054    2570 flags.go:64] FLAG: --cloud-provider="external"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632057    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632062    2570 flags.go:64] FLAG: --cluster-domain=""
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632065    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632068    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632071    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632074    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jun 11 21:15:15.637554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632077    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632080    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632085    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632088    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632091    2570 flags.go:64] FLAG: --contention-profiling="false"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632094    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632097    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632101    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632104    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632108    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632111    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632113    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632116    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632119    2570 flags.go:64] FLAG: --enable-server="true"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632122    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632126    2570 flags.go:64] FLAG: --event-burst="100"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632128    2570 flags.go:64] FLAG: --event-qps="50"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632132    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632134    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632137    2570 flags.go:64] FLAG: --eviction-hard=""
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632141    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632144    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632147    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632150    2570 flags.go:64] FLAG: --eviction-soft=""
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632153    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 11 21:15:15.638133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632156    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632159    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632161    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632164    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632167    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632169    2570 flags.go:64] FLAG: --feature-gates=""
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632173    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632176    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632179    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632183    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632186    2570 flags.go:64] FLAG: --healthz-port="10248"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632188    2570 flags.go:64] FLAG: --help="false"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632201    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632206    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632209    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632212    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632216    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632219    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632222    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632225    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632228    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632230    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632233    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632236    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jun 11 21:15:15.638843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632239    2570 flags.go:64] FLAG: --kube-reserved=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632242    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632245    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632249    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632251    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632267    2570 flags.go:64] FLAG: --lock-file=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632270    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632274    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632277    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632282    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632285    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632288    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632291    2570 flags.go:64] FLAG: --logging-format="text"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632293    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632297    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632300    2570 flags.go:64] FLAG: --manifest-url=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632302    2570 flags.go:64] FLAG: --manifest-url-header=""
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632308    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632311    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632315    2570 flags.go:64] FLAG: --max-pods="110"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632318    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632322    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632325    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632327    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632330    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 11 21:15:15.639586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632333    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632336    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632343    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632346    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632348    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632351    2570 flags.go:64] FLAG: --pod-cidr=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632354    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632359    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632362    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632365    2570 flags.go:64] FLAG: --pods-per-core="0"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632367    2570 flags.go:64] FLAG: --port="10250"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632370    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632373    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0155831c86d131b27"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632376    2570 flags.go:64] FLAG: --qos-reserved=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632379    2570 flags.go:64] FLAG: --read-only-port="10255"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632382    2570 flags.go:64] FLAG: --register-node="true"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632385    2570 flags.go:64] FLAG: --register-with-taints=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632389    2570 flags.go:64] FLAG: --registry-burst="10"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632392    2570 flags.go:64] FLAG: --registry-qps="5"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632395    2570 flags.go:64] FLAG: --reserved-cpus=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632398    2570 flags.go:64] FLAG: --reserved-memory=""
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632401    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632404    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632407    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632411    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 11 21:15:15.640210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632414    2570 flags.go:64] FLAG: --runonce="false"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632417    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632420    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632423    2570 flags.go:64] FLAG: --seccomp-default="false"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632426    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632429    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632432    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632435    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632438    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632441    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632444    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632446    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632449    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632452    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632455    2570 flags.go:64] FLAG: --system-cgroups=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632457    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632463    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632466    2570 flags.go:64] FLAG: --tls-cert-file=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632468    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632473    2570 flags.go:64] FLAG: --tls-min-version=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632475    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632478    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632481    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632484    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632487    2570 flags.go:64] FLAG: --v="2"
Jun 11 21:15:15.640872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632490    2570 flags.go:64] FLAG: --version="false"
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632494    2570 flags.go:64] FLAG: --vmodule=""
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632498    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.632500    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632616    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632621    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632626    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632629    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632632    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632635    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632638    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632643    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632646    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632649    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632652    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632655    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632658    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632661    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632663    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632666    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.641513 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632669    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632671    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632674    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632676    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632679    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632681    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632684    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632686    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632689    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632691    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632694    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632697    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632699    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632702    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632705    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632707    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632710    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632712    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632716    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632719    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.642037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632721    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632724    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632726    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632730    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632733    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632736    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632738    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632741    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632743    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632746    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632748    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632751    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632753    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632758    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632761    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632764    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632766    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632768    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632771    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.642560 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632773    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632776    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632779    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632781    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632784    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632787    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632790    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632793    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632795    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632797    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632800    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632803    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632806    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632808    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632811    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632813    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632817    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632820    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632822    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632825    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.643028 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632828    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632830    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632833    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632835    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632838    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632840    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632843    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632845    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632848    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632850    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632855    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632858    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632861    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632864    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632867    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632869    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632872    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632874    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632877    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632879    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.643538 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632882    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632884    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632887    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.632890    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.633425    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641091    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641106    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641124    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641130    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641192    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641197    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641200    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641203    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641206    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641210    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.644010 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641213    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641216    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641218    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641221    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641224    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641227    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641230    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641233    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641235    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641238    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641240    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641243    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641245    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641248    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641250    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641268    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641271    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641273    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641276    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641278    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.644565 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641283    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641286    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641288    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641291    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641294    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641297    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641300    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641302    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641305    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641307    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641310    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641313    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641315    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641318    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641320    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641323    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641326    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641328    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641331    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641333    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.645053 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641335    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641338    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641340    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641343    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641345    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641347    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641350    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641352    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641355    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641357    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641360    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641362    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641365    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641368    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641370    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641373    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641376    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641379    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641381    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.645606 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641384    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641386    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641388    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641391    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641394    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641396    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641399    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641401    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641403    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641406    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641410    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641414    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641418    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641421    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641424    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641427    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641430    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641433    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641435    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.646073 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641438    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641441    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641443    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641446    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641448    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641451    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641453    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641455    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641458    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641461    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641463    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641466    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641469    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641471    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641474    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.646550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641479    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641607    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641612    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641615    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641617    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641620    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641622    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641624    2570 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641628    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641632    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641634    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641637    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641639    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641641    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641644    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641647    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641649    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641652    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641654    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641657    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 21:15:15.646928 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641659    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641661    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641664    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641666    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641668    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641671    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641673    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641675    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641678    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641681    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641684    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641686    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641689    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641691    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641694    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641696    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641698    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641701    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641703    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641705    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 21:15:15.647473 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641708    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641710    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641713    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641715    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641717    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641720    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641722    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641725    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641727    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641731    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641734    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641737    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641740    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641743    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641745    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641747    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641750    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641752    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641755    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 21:15:15.647958 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641757    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641760    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641762    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641766    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641768    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641770    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641773    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641775    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641777    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641780    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641782    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641784    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641787    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641790    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641792    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641795    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641797    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641799    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641801    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641804    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 21:15:15.648603 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641806    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641809    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641812    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641814    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641817    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641819    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641821    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641824    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641828    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641831    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641833    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641836    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641839    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641842    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641845    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641847    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641851    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641853    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641855    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641858    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 21:15:15.649077 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:15.641860    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641865    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.641971    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.643938    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.645068    2570 server.go:1019] "Starting client certificate rotation"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.645168    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.645200    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.647154    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 21:15:15.649697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.648331    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 21:15:15.664518 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.660758    2570 log.go:25] "Validated CRI v1 runtime API"
Jun 11 21:15:15.664518 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.663413    2570 log.go:25] "Validated CRI v1 image API"
Jun 11 21:15:15.665535 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.665515    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 11 21:15:15.668165 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.668147    2570 fs.go:135] Filesystem UUIDs: map[4fb867f1-05be-471a-aa39-4bceb543fb61:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d4af0543-e001-497c-8555-b8ddeee714b1:/dev/nvme0n1p4]
Jun 11 21:15:15.668232 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.668166    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 11 21:15:15.674384 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.674238    2570 manager.go:216] Machine: {Timestamp:2026-06-11 21:15:15.672999398 +0000 UTC m=+0.253934490 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131590 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a34598c05795e076ae7749ea6098 SystemUUID:ec21a345-98c0-5795-e076-ae7749ea6098 BootID:f6227a2e-a17c-48dc-ab28-2c785e6e54ad Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:19:a5:a8:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:19:a5:a8:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:ce:a4:b3:b9:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 11 21:15:15.674384 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.674374    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 11 21:15:15.674504 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.674462    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 11 21:15:15.677048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.677018    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 11 21:15:15.677202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.677051    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 11 21:15:15.678128 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.678114    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jun 11 21:15:15.678164 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.678131    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jun 11 21:15:15.678164 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.678139    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 21:15:15.678672 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.678659    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 21:15:15.679857 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.679842    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 11 21:15:15.682373 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.682360    2570 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 21:15:15.682496 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.682487    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 11 21:15:15.683016 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683006    2570 kubelet.go:486] "Attempting to sync node with API server"
Jun 11 21:15:15.683045 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683022    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 11 21:15:15.683045 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683039    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 11 21:15:15.683108 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683048    2570 kubelet.go:398] "Adding apiserver pod source"
Jun 11 21:15:15.683108 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683060    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 11 21:15:15.683469 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683457    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 21:15:15.683517 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.683481    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 21:15:15.685209 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.685191    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 11 21:15:15.685781 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.685756    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 21:15:15.686849 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.686836    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 11 21:15:15.686887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.686868    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 11 21:15:15.687455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687443    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 11 21:15:15.687488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687467    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 11 21:15:15.687488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687481    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 11 21:15:15.687545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687493    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 11 21:15:15.687545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687515    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 11 21:15:15.687545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687526    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687547    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687560    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687571    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687580    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687588    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 11 21:15:15.687624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.687594    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 11 21:15:15.688184 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.688173    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 11 21:15:15.688184 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.688183    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 11 21:15:15.691527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.691509    2570 server.go:1268] "Started kubelet"
Jun 11 21:15:15.691619 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.691580    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 11 21:15:15.692023 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.691689    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 11 21:15:15.692023 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.691939    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 11 21:15:15.692375 ip-10-0-133-9 systemd[1]: Started Kubernetes Kubelet.
Jun 11 21:15:15.695557 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.695497    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 11 21:15:15.698055 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.698035    2570 server.go:310] "Adding debug handlers to kubelet server"
Jun 11 21:15:15.698352 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.698333    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 11 21:15:15.699873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.699857    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 11 21:15:15.699932 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.699850    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 11 21:15:15.700016 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.699997    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 11 21:15:15.700381 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.700368    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 11 21:15:15.700472 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.700454    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:15.700528 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.700482    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.699900    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b8235883452a70  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 21:15:15.69147352 +0000 UTC m=+0.272408612,LastTimestamp:2026-06-11 21:15:15.69147352 +0000 UTC m=+0.272408612,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.700912    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.700924    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.700941    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701014    2570 reconstruct.go:97] "Volume reconstruction finished"
Jun 11 21:15:15.701123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701022    2570 reconciler.go:29] "Reconciler: start to sync state"
Jun 11 21:15:15.701467 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701390    2570 factory.go:55] Registering systemd factory
Jun 11 21:15:15.701467 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701407    2570 factory.go:223] Registration of the systemd container factory successfully
Jun 11 21:15:15.701746 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701641    2570 factory.go:153] Registering CRI-O factory
Jun 11 21:15:15.701746 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701657    2570 factory.go:223] Registration of the crio container factory successfully
Jun 11 21:15:15.701746 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701722    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 11 21:15:15.701746 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701746    2570 factory.go:103] Registering Raw factory
Jun 11 21:15:15.702026 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.701760    2570 manager.go:1196] Started watching for new ooms in manager
Jun 11 21:15:15.703015 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.702996    2570 manager.go:349] Starting recovery of all containers
Jun 11 21:15:15.711402 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.711247    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 11 21:15:15.711402 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.711334    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 11 21:15:15.713896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.713881    2570 manager.go:354] Recovery completed
Jun 11 21:15:15.718300 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.718281    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.720581 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.720558    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.720718 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.720599    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.720718 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.720613    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.721139 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.721126    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 11 21:15:15.721194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.721140    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 11 21:15:15.721194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.721160    2570 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 21:15:15.721293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.721193    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.722407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722392    2570 policy_none.go:49] "None policy: Start"
Jun 11 21:15:15.722490 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722410    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 11 21:15:15.722490 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722425    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 11 21:15:15.722601 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722585    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.722649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722614    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.722649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.722623    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.723192 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.723117    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b8235885015075  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 21:15:15.720581237 +0000 UTC m=+0.301516332,LastTimestamp:2026-06-11 21:15:15.720581237 +0000 UTC m=+0.301516332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}"
Jun 11 21:15:15.723458 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.723446    2570 policy_none.go:47] "Start"
Jun 11 21:15:15.736123 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.736043    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b823588501af38  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-9.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 21:15:15.720605496 +0000 UTC m=+0.301540589,LastTimestamp:2026-06-11 21:15:15.720605496 +0000 UTC m=+0.301540589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}"
Jun 11 21:15:15.746524 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.746445    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b823588501e262  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-9.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 21:15:15.720618594 +0000 UTC m=+0.301553687,LastTimestamp:2026-06-11 21:15:15.720618594 +0000 UTC m=+0.301553687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}"
Jun 11 21:15:15.754549 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.754523    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljjjp"
Jun 11 21:15:15.760793 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.760703    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-9.ec2.internal.18b8235885015075\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b8235885015075  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 21:15:15.720581237 +0000 UTC m=+0.301516332,LastTimestamp:2026-06-11 21:15:15.722600961 +0000 UTC m=+0.303536053,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762073    2570 manager.go:337] "Starting Device Plugin manager"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.762116    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762132    2570 server.go:87] "Starting device plugin registration server"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762433    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762445    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762533    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljjjp"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762558    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762747    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.762755    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.764939    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.764996    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.773151    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.774501    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.774547    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.774574    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.774615    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 11 21:15:15.777550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.776886    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:15.862709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.862676    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.864897 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.864880    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.865021 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.864917    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.865021 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.864931    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.865021 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.864960    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.871636 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.871618    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.871719 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.871643    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-9.ec2.internal\": node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:15.875083 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.875062    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"]
Jun 11 21:15:15.875139 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.875128    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.876051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.875995    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.876051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.876030    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.876051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.876043    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.877390 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.877378    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.877540 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.877526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.877581 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.877557    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.878144 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878128    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.878246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878150    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.878246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878175    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.878246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878190    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.878246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878157    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.878246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.878247    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.879449 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.879433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.879545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.879463    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 21:15:15.880167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.880155    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 21:15:15.880283 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.880181    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 21:15:15.880283 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:15.880205    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID"
Jun 11 21:15:15.903823 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.903801    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:15.904338 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.904320    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-9.ec2.internal\" not found" node="ip-10-0-133-9.ec2.internal"
Jun 11 21:15:15.908690 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:15.908673    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-9.ec2.internal\" not found" node="ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.002225 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.002193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7fef89a041c43606001c87b66f83a9e8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"7fef89a041c43606001c87b66f83a9e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.002225 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.002229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.002441 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.002273    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.004318 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.004298    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.103195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7fef89a041c43606001c87b66f83a9e8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"7fef89a041c43606001c87b66f83a9e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.103305 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.103305 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.103305 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103286    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.103305 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103286    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7fef89a041c43606001c87b66f83a9e8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"7fef89a041c43606001c87b66f83a9e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.103431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.103298    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/816c07a2abc1a7623c792353b76fa288-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"816c07a2abc1a7623c792353b76fa288\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.105269 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.105235    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.206216 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.206154    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.207251 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.207232    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.211720 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.211705    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.307323 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.307278    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.407850 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.407803    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.508407 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.508321    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found"
Jun 11 21:15:16.568994 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.568966    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:16.601194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.601159    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.615523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.615500    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 21:15:16.616242 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.616224    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"
Jun 11 21:15:16.616888 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.616872    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:16.625864 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.625835    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 21:15:16.644973 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.644942    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 11 21:15:16.645585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.645144    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 21:15:16.645585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.645162    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 21:15:16.682667 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.682635    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:16.683634 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.683615    2570 apiserver.go:52] "Watching apiserver"
Jun 11 21:15:16.690024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.690002    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 11 21:15:16.691929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.691434    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2kvgc","kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8","openshift-dns/node-resolver-489ln","openshift-image-registry/node-ca-57b5h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal","openshift-multus/multus-9tftw","openshift-multus/network-metrics-daemon-mhf2x","kube-system/global-pull-secret-syncer-l5m7k","openshift-cluster-node-tuning-operator/tuned-qb7sn","openshift-multus/multus-additional-cni-plugins-4l7q8","openshift-network-diagnostics/network-check-target-xmqg8","openshift-network-operator/iptables-alerter-qp75j","openshift-ovn-kubernetes/ovnkube-node-6gdgq"]
Jun 11 21:15:16.692978 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.692952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.694100 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.694079    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.695058 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.695039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.695157 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.695116    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:16.695466 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.695446    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wmhjx\""
Jun 11 21:15:16.695549 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.695454    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.695606 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.695454    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.696078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.696059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:16.696160 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.696133    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:16.696314 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.696297    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.696377 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.696331    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.696477 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.696462    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 11 21:15:16.696531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.696473    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 11 21:15:16.697029 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.697010    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.697177 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.697160    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 11 21:15:16.697439 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.697427    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xnwzj\""
Jun 11 21:15:16.698280 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.698250    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.699018 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.699002    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lmmct\""
Jun 11 21:15:16.699133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.699121    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 11 21:15:16.699411 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.699399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.699476 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.699458    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:16.700493 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700476    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.700554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700535    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cjc52\""
Jun 11 21:15:16.700554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700477    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.700647 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.700697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700667    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 11 21:15:16.700809 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.700791    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 11 21:15:16.701939 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.701924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.702604 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.702549    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.702717 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.702611    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 11 21:15:16.702717 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.702638    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-67d56\""
Jun 11 21:15:16.702897 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.702882    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.702995 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.702981    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.704104 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.704074    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 11 21:15:16.704104 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.704089    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jrt7d\""
Jun 11 21:15:16.704282 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.704179    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.704687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.704670    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 11 21:15:16.705060 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.705046    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.705368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.705354    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.705452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.705435    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pr9dx\""
Jun 11 21:15:16.705664 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.705648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.706445 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcxxv\" (UniqueName: \"kubernetes.io/projected/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-kube-api-access-wcxxv\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.706527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbl9\" (UniqueName: \"kubernetes.io/projected/1659540e-4667-4024-886d-2536e3097f09-kube-api-access-5wbl9\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.706527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cnibin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-k8s-cni-cncf-io\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-systemd\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-iptables-alerter-script\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-system-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-multus\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706690    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-daemon-config\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706710    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcqh\" (UniqueName: \"kubernetes.io/projected/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-kube-api-access-dvcqh\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-serviceca\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-system-cni-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-cnibin\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.706843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706819    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-os-release\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cni-binary-copy\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4759d092-5db8-40fe-9f65-32a08a01e89c-agent-certs\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706928    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4759d092-5db8-40fe-9f65-32a08a01e89c-konnectivity-ca\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.706999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-kubelet\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-kubelet-config\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.707092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-conf\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-run\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-host\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-host-slash\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-netns\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-conf-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-sys\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707319    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdfsm\" (UniqueName: \"kubernetes.io/projected/2a1f7c46-913b-488d-a70c-15c92addac5e-kube-api-access-hdfsm\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-os-release\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707353    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-socket-dir-parent\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-hostroot\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-host\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707402    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzvh\" (UniqueName: \"kubernetes.io/projected/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-kube-api-access-bnzvh\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-modprobe-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysconfig\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.707485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-lib-modules\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-multus-certs\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-etc-kubernetes\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-dbus\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-tuned\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-bin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-kubernetes\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-var-lib-kubelet\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-tmp\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.707872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9bj\" (UniqueName: \"kubernetes.io/projected/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-kube-api-access-2p9bj\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.708114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.708008    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 11 21:15:16.708751 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.708737    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.709219 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.709072    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 11 21:15:16.709219 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.709083    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 11 21:15:16.709219 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.709127    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w89qw\""
Jun 11 21:15:16.709511 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.709494    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 11 21:15:16.710454 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.710433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 11 21:15:16.710454 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.710445    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.710603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.710455    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4v5gd\""
Jun 11 21:15:16.710603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.710598    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 11 21:15:16.711782 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.711764    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 11 21:15:16.714652 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.714636    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 21:15:16.723418 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:16.723382    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fef89a041c43606001c87b66f83a9e8.slice/crio-0dd60c3877f2dfe9d889c62af883a8cb2116cefa9fbe4a98024553da5b4f719e WatchSource:0}: Error finding container 0dd60c3877f2dfe9d889c62af883a8cb2116cefa9fbe4a98024553da5b4f719e: Status 404 returned error can't find the container with id 0dd60c3877f2dfe9d889c62af883a8cb2116cefa9fbe4a98024553da5b4f719e
Jun 11 21:15:16.723992 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:16.723973    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816c07a2abc1a7623c792353b76fa288.slice/crio-1f96ecc932c23d825933422a7104e8cf32572b552888f9e4f3600a20fd07e99b WatchSource:0}: Error finding container 1f96ecc932c23d825933422a7104e8cf32572b552888f9e4f3600a20fd07e99b: Status 404 returned error can't find the container with id 1f96ecc932c23d825933422a7104e8cf32572b552888f9e4f3600a20fd07e99b
Jun 11 21:15:16.730569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.730549    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 21:15:16.741130 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.741100    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvvn4"
Jun 11 21:15:16.752451 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.752422    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvvn4"
Jun 11 21:15:16.767097 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.767054    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:10:15 +0000 UTC" deadline="2027-12-03 04:32:53.426851822 +0000 UTC"
Jun 11 21:15:16.767097 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.767097    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12943h17m36.659757296s"
Jun 11 21:15:16.778013 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.777964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"816c07a2abc1a7623c792353b76fa288","Type":"ContainerStarted","Data":"1f96ecc932c23d825933422a7104e8cf32572b552888f9e4f3600a20fd07e99b"}
Jun 11 21:15:16.778946 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.778910    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" event={"ID":"7fef89a041c43606001c87b66f83a9e8","Type":"ContainerStarted","Data":"0dd60c3877f2dfe9d889c62af883a8cb2116cefa9fbe4a98024553da5b4f719e"}
Jun 11 21:15:16.802020 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.801982    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 11 21:15:16.808990 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.808961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.809090 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.808998    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-netd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.809090 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.809194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-conf\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.809194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-host-slash\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.809194 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.809158    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809200    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-host-slash\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.809238    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:17.309201684 +0000 UTC m=+1.890136793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-config\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-netns\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809338    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-conf\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.809360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-sys\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.809401    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809415    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-netns\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809422    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.809439    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:17.309426678 +0000 UTC m=+1.890361764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-netns\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809465    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-sys\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-os-release\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-hostroot\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysconfig\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-node-log\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-hostroot\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.809602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-multus-certs\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809619    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-os-release\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-etc-kubernetes\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809648    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-multus-certs\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809615    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysconfig\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-dbus\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-tuned\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809687    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-etc-kubernetes\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-slash\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-systemd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpgk5\" (UniqueName: \"kubernetes.io/projected/ae4f0792-6d63-4b81-9cf7-3e1537559f30-kube-api-access-fpgk5\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-var-lib-kubelet\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809781    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-dbus\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-var-lib-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809842    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-log-socket\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810048 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809846    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-var-lib-kubelet\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809887    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcxxv\" (UniqueName: \"kubernetes.io/projected/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-kube-api-access-wcxxv\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-systemd\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e06bc113-442c-42db-9db3-3ea0fa6ce504-hosts-file\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809991    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww69n\" (UniqueName: \"kubernetes.io/projected/e06bc113-442c-42db-9db3-3ea0fa6ce504-kube-api-access-ww69n\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.809995    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-systemd\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-etc-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-env-overrides\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810165    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-multus\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtvv\" (UniqueName: \"kubernetes.io/projected/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kube-api-access-bmtvv\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810221    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-bin\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810239    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-multus\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-run\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.810705 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810329    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810330    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-system-cni-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-cnibin\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810363    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-system-cni-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810420    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-cnibin\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810375    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-run\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cni-binary-copy\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-device-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-kubelet\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810533    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-kubelet\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-kubelet-config\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810577    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-kubelet\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-host\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-conf-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.811420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810639    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-host\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810646    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10907c69-8e2f-49a6-bf6f-16a0a340b680-kubelet-config\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810651    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdfsm\" (UniqueName: \"kubernetes.io/projected/2a1f7c46-913b-488d-a70c-15c92addac5e-kube-api-access-hdfsm\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810676    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-conf-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovn-node-metrics-cert\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-script-lib\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-socket-dir-parent\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810773    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-host\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzvh\" (UniqueName: \"kubernetes.io/projected/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-kube-api-access-bnzvh\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810817    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-socket-dir-parent\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-modprobe-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-lib-modules\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-ovn\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810909    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cni-binary-copy\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-bin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-kubernetes\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810957    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-host\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810980    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-lib-modules\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810987    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.810915    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-modprobe-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811035    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-kubernetes\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-tmp\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9bj\" (UniqueName: \"kubernetes.io/projected/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-kube-api-access-2p9bj\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811106    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-var-lib-cni-bin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811127    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-sysctl-d\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-systemd-units\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbl9\" (UniqueName: \"kubernetes.io/projected/1659540e-4667-4024-886d-2536e3097f09-kube-api-access-5wbl9\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cnibin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-k8s-cni-cncf-io\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-iptables-alerter-script\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.812891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-system-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811341    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-host-run-k8s-cni-cncf-io\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811315    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-cnibin\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811391    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-system-cni-dir\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-daemon-config\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcqh\" (UniqueName: \"kubernetes.io/projected/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-kube-api-access-dvcqh\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-serviceca\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-os-release\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811516    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4759d092-5db8-40fe-9f65-32a08a01e89c-agent-certs\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4759d092-5db8-40fe-9f65-32a08a01e89c-konnectivity-ca\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06bc113-442c-42db-9db3-3ea0fa6ce504-tmp-dir\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.811664    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1659540e-4667-4024-886d-2536e3097f09-os-release\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.812037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-multus-daemon-config\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.812077    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1659540e-4667-4024-886d-2536e3097f09-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.812288    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-serviceca\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.812339    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4759d092-5db8-40fe-9f65-32a08a01e89c-konnectivity-ca\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.812485    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-iptables-alerter-script\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.813502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.813507    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-tmp\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.814073 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.813579    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a1f7c46-913b-488d-a70c-15c92addac5e-etc-tuned\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.814635 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.814619    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4759d092-5db8-40fe-9f65-32a08a01e89c-agent-certs\") pod \"konnectivity-agent-2kvgc\" (UID: \"4759d092-5db8-40fe-9f65-32a08a01e89c\") " pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:16.818994 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.818975    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:16.819094 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.819000    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:16.819094 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.819013    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:16.819094 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:16.819072    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:17.319054971 +0000 UTC m=+1.899990070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:16.821154 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.821137    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcxxv\" (UniqueName: \"kubernetes.io/projected/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-kube-api-access-wcxxv\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:16.821789 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.821768    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdfsm\" (UniqueName: \"kubernetes.io/projected/2a1f7c46-913b-488d-a70c-15c92addac5e-kube-api-access-hdfsm\") pod \"tuned-qb7sn\" (UID: \"2a1f7c46-913b-488d-a70c-15c92addac5e\") " pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:16.823234 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.823218    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9bj\" (UniqueName: \"kubernetes.io/projected/17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd-kube-api-access-2p9bj\") pod \"iptables-alerter-qp75j\" (UID: \"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd\") " pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:16.828444 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.828420    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbl9\" (UniqueName: \"kubernetes.io/projected/1659540e-4667-4024-886d-2536e3097f09-kube-api-access-5wbl9\") pod \"multus-additional-cni-plugins-4l7q8\" (UID: \"1659540e-4667-4024-886d-2536e3097f09\") " pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:16.828781 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.828760    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcqh\" (UniqueName: \"kubernetes.io/projected/3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9-kube-api-access-dvcqh\") pod \"multus-9tftw\" (UID: \"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9\") " pod="openshift-multus/multus-9tftw"
Jun 11 21:15:16.829531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.829513    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzvh\" (UniqueName: \"kubernetes.io/projected/fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9-kube-api-access-bnzvh\") pod \"node-ca-57b5h\" (UID: \"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9\") " pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:16.912000 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.911964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912000 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.911998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-systemd-units\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06bc113-442c-42db-9db3-3ea0fa6ce504-tmp-dir\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-netd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912081    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-systemd-units\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-config\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912139    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-netd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912158    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-sys-fs\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912168    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-netns\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912178    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-socket-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912236    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-netns\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-node-log\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912285    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-slash\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912336    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-node-log\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-systemd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpgk5\" (UniqueName: \"kubernetes.io/projected/ae4f0792-6d63-4b81-9cf7-3e1537559f30-kube-api-access-fpgk5\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912380    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-systemd\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-var-lib-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912408    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06bc113-442c-42db-9db3-3ea0fa6ce504-tmp-dir\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912439    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-registration-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912451    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-var-lib-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912390    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-slash\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-log-socket\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e06bc113-442c-42db-9db3-3ea0fa6ce504-hosts-file\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912492    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-log-socket\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww69n\" (UniqueName: \"kubernetes.io/projected/e06bc113-442c-42db-9db3-3ea0fa6ce504-kube-api-access-ww69n\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.912870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-etc-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-etc-openvswitch\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-env-overrides\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtvv\" (UniqueName: \"kubernetes.io/projected/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kube-api-access-bmtvv\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912624    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912616    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e06bc113-442c-42db-9db3-3ea0fa6ce504-hosts-file\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912699    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-bin\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912754    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-cni-bin\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-device-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912763    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-config\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912780    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-kubelet\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912814    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-device-dir\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912822    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-host-kubelet\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovn-node-metrics-cert\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912855    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-script-lib\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-ovn\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912948    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ae4f0792-6d63-4b81-9cf7-3e1537559f30-run-ovn\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912967    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-env-overrides\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.912985    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.913853 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.913232    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovnkube-script-lib\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.915148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.915129    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae4f0792-6d63-4b81-9cf7-3e1537559f30-ovn-node-metrics-cert\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:16.921317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.921288    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww69n\" (UniqueName: \"kubernetes.io/projected/e06bc113-442c-42db-9db3-3ea0fa6ce504-kube-api-access-ww69n\") pod \"node-resolver-489ln\" (UID: \"e06bc113-442c-42db-9db3-3ea0fa6ce504\") " pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:16.921490 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.921470    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtvv\" (UniqueName: \"kubernetes.io/projected/8a1583cb-3a0f-4fba-85cb-727953d7f7b3-kube-api-access-bmtvv\") pod \"aws-ebs-csi-driver-node-jgmd8\" (UID: \"8a1583cb-3a0f-4fba-85cb-727953d7f7b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:16.921588 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:16.921570    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpgk5\" (UniqueName: \"kubernetes.io/projected/ae4f0792-6d63-4b81-9cf7-3e1537559f30-kube-api-access-fpgk5\") pod \"ovnkube-node-6gdgq\" (UID: \"ae4f0792-6d63-4b81-9cf7-3e1537559f30\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:17.027434 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.027346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qb7sn"
Jun 11 21:15:17.033053 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.033028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4l7q8"
Jun 11 21:15:17.035498 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.035471    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1f7c46_913b_488d_a70c_15c92addac5e.slice/crio-3753f4a8bbb7cf6d085fa58cc4663c0c5cc696443abe3d32c7a608c8bd913318 WatchSource:0}: Error finding container 3753f4a8bbb7cf6d085fa58cc4663c0c5cc696443abe3d32c7a608c8bd913318: Status 404 returned error can't find the container with id 3753f4a8bbb7cf6d085fa58cc4663c0c5cc696443abe3d32c7a608c8bd913318
Jun 11 21:15:17.040445 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.040414    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9tftw"
Jun 11 21:15:17.040703 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.040678    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1659540e_4667_4024_886d_2536e3097f09.slice/crio-7a0799e4e19c4ea40cf2b7f568b7790af99daeda1cc2a7a6df2abf8320a85b12 WatchSource:0}: Error finding container 7a0799e4e19c4ea40cf2b7f568b7790af99daeda1cc2a7a6df2abf8320a85b12: Status 404 returned error can't find the container with id 7a0799e4e19c4ea40cf2b7f568b7790af99daeda1cc2a7a6df2abf8320a85b12
Jun 11 21:15:17.045010 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.044986    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-57b5h"
Jun 11 21:15:17.049354 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.049330    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb7a572_2bd0_412f_8ac0_c1a6e615f5e9.slice/crio-780014cfb6f0eeb2905db031ae0e4a0ef51cbe67f569de47ea14c96ba765778a WatchSource:0}: Error finding container 780014cfb6f0eeb2905db031ae0e4a0ef51cbe67f569de47ea14c96ba765778a: Status 404 returned error can't find the container with id 780014cfb6f0eeb2905db031ae0e4a0ef51cbe67f569de47ea14c96ba765778a
Jun 11 21:15:17.051235 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.051215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qp75j"
Jun 11 21:15:17.053973 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.053951    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2d51f9_0c0d_47df_ac04_a4f0cc73eaa9.slice/crio-993d0740f47b013c12e81a5d15f52b6fdb63b80e143a7501650e9af04bdd5bdd WatchSource:0}: Error finding container 993d0740f47b013c12e81a5d15f52b6fdb63b80e143a7501650e9af04bdd5bdd: Status 404 returned error can't find the container with id 993d0740f47b013c12e81a5d15f52b6fdb63b80e143a7501650e9af04bdd5bdd
Jun 11 21:15:17.057300 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.057282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:17.059092 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.059069    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cfa36f_4b08_4cf8_9ec9_576e2b1e40dd.slice/crio-4e6bcf17d242d0845325952c02a0d6e10fee1f8729fad4d94ed516413251c1c9 WatchSource:0}: Error finding container 4e6bcf17d242d0845325952c02a0d6e10fee1f8729fad4d94ed516413251c1c9: Status 404 returned error can't find the container with id 4e6bcf17d242d0845325952c02a0d6e10fee1f8729fad4d94ed516413251c1c9
Jun 11 21:15:17.062973 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.062950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-489ln"
Jun 11 21:15:17.065609 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.065588    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4759d092_5db8_40fe_9f65_32a08a01e89c.slice/crio-644d5d6371e7a57d997f761c72111c5c3b5bf1000593d58459390d4afc8fa595 WatchSource:0}: Error finding container 644d5d6371e7a57d997f761c72111c5c3b5bf1000593d58459390d4afc8fa595: Status 404 returned error can't find the container with id 644d5d6371e7a57d997f761c72111c5c3b5bf1000593d58459390d4afc8fa595
Jun 11 21:15:17.069569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.069547    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8"
Jun 11 21:15:17.071801 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.071772    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06bc113_442c_42db_9db3_3ea0fa6ce504.slice/crio-2630947cd50c589c296fd43ad31f0ef0c166e6587b82f70a8a273d453aa7ae04 WatchSource:0}: Error finding container 2630947cd50c589c296fd43ad31f0ef0c166e6587b82f70a8a273d453aa7ae04: Status 404 returned error can't find the container with id 2630947cd50c589c296fd43ad31f0ef0c166e6587b82f70a8a273d453aa7ae04
Jun 11 21:15:17.072865 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.072847    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:17.077511 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.077492    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1583cb_3a0f_4fba_85cb_727953d7f7b3.slice/crio-5399657e5e8762b73528587e9c66cdb839de5cacf1cc0a52d7832c57b0bb376c WatchSource:0}: Error finding container 5399657e5e8762b73528587e9c66cdb839de5cacf1cc0a52d7832c57b0bb376c: Status 404 returned error can't find the container with id 5399657e5e8762b73528587e9c66cdb839de5cacf1cc0a52d7832c57b0bb376c
Jun 11 21:15:17.081375 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:17.081354    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4f0792_6d63_4b81_9cf7_3e1537559f30.slice/crio-ed01b9a46f1d06fc9a9aff566c89d5cce11b1c8ed00191cf11539137ac10c04f WatchSource:0}: Error finding container ed01b9a46f1d06fc9a9aff566c89d5cce11b1c8ed00191cf11539137ac10c04f: Status 404 returned error can't find the container with id ed01b9a46f1d06fc9a9aff566c89d5cce11b1c8ed00191cf11539137ac10c04f
Jun 11 21:15:17.315643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.315554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:17.315643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.315612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:17.315846 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.315823    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:17.315908 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.315886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:18.315868085 +0000 UTC m=+2.896803166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:17.316076 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.316057    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:17.316144 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.316113    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:18.316099295 +0000 UTC m=+2.897034391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:17.416873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.416834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:17.417060 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.417000    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:17.417060 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.417023    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:17.417060 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.417035    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:17.417234 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:17.417095    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:18.417075794 +0000 UTC m=+2.998010889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:17.755599 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.755500    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:10:16 +0000 UTC" deadline="2027-12-28 13:20:25.778715979 +0000 UTC"
Jun 11 21:15:17.755599 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.755556    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h5m8.023164939s"
Jun 11 21:15:17.803646 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.803601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2kvgc" event={"ID":"4759d092-5db8-40fe-9f65-32a08a01e89c","Type":"ContainerStarted","Data":"644d5d6371e7a57d997f761c72111c5c3b5bf1000593d58459390d4afc8fa595"}
Jun 11 21:15:17.827582 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.827537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qp75j" event={"ID":"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd","Type":"ContainerStarted","Data":"4e6bcf17d242d0845325952c02a0d6e10fee1f8729fad4d94ed516413251c1c9"}
Jun 11 21:15:17.830029 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.829996    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:17.845383 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.844978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9tftw" event={"ID":"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9","Type":"ContainerStarted","Data":"780014cfb6f0eeb2905db031ae0e4a0ef51cbe67f569de47ea14c96ba765778a"}
Jun 11 21:15:17.853317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.853220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerStarted","Data":"7a0799e4e19c4ea40cf2b7f568b7790af99daeda1cc2a7a6df2abf8320a85b12"}
Jun 11 21:15:17.870766 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.870723    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qb7sn" event={"ID":"2a1f7c46-913b-488d-a70c-15c92addac5e","Type":"ContainerStarted","Data":"3753f4a8bbb7cf6d085fa58cc4663c0c5cc696443abe3d32c7a608c8bd913318"}
Jun 11 21:15:17.901028 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.900988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"ed01b9a46f1d06fc9a9aff566c89d5cce11b1c8ed00191cf11539137ac10c04f"}
Jun 11 21:15:17.920956 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.920917    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8" event={"ID":"8a1583cb-3a0f-4fba-85cb-727953d7f7b3","Type":"ContainerStarted","Data":"5399657e5e8762b73528587e9c66cdb839de5cacf1cc0a52d7832c57b0bb376c"}
Jun 11 21:15:17.924695 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.924335    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-489ln" event={"ID":"e06bc113-442c-42db-9db3-3ea0fa6ce504","Type":"ContainerStarted","Data":"2630947cd50c589c296fd43ad31f0ef0c166e6587b82f70a8a273d453aa7ae04"}
Jun 11 21:15:17.936421 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:17.936380    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-57b5h" event={"ID":"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9","Type":"ContainerStarted","Data":"993d0740f47b013c12e81a5d15f52b6fdb63b80e143a7501650e9af04bdd5bdd"}
Jun 11 21:15:18.325771 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.325731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:18.325949 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.325785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:18.325949 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.325929    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:18.326051 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.325990    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:20.325971292 +0000 UTC m=+4.906906374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:18.326598 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.326377    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:18.326598 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.326429    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:20.326413752 +0000 UTC m=+4.907348835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:18.426514 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.426476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:18.426686 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.426627    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:18.426686 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.426649    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:18.426686 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.426660    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:18.426834 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.426715    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:20.426697286 +0000 UTC m=+5.007632386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:18.504294 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.503859    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 21:15:18.756776 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.756671    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:10:16 +0000 UTC" deadline="2028-03-25 13:17:55.127713384 +0000 UTC"
Jun 11 21:15:18.756776 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.756732    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15664h2m36.37098614s"
Jun 11 21:15:18.775506 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.775474    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:18.775651 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.775615    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:18.776022 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.775997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:18.776114 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.776094    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:18.776181 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:18.776166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:18.776275 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:18.776244    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:20.343903 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.343862    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:20.344385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.343925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:20.344385 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.344061    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:20.344385 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.344123    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:24.344104796 +0000 UTC m=+8.925039876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:20.344385 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.344205    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:20.344385 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.344244    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:24.344231446 +0000 UTC m=+8.925166528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:20.444781 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.444744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:20.444951 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.444893    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:20.444951 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.444919    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:20.444951 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.444932    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:20.445121 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.444996    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:24.444977104 +0000 UTC m=+9.025912200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.774792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.774939    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.775001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.775072    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:20.775112    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:20.775578 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:20.775175    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:22.775203 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:22.775167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:22.775606 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:22.775318    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:22.775965 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:22.775716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:22.775965 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:22.775820    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:22.775965 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:22.775864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:22.775965 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:22.775929    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:24.379929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.379882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:24.380434 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.379989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:24.380434 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.380015    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:24.380434 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.380063    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:24.380434 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.380080    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:32.3800605 +0000 UTC m=+16.960995581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:24.380434 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.380097    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:32.38008687 +0000 UTC m=+16.961021963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:24.481051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.480991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:24.481470 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.481241    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:24.481470 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.481286    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:24.481470 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.481300    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:24.481470 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.481371    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:32.48135098 +0000 UTC m=+17.062286064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:24.775224 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.775134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:24.775414 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.775290    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:24.775631 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.775612    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:24.775743 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.775685    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:24.775743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:24.775741    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:24.775831 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:24.775815    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:26.775037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:26.775006    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:26.775585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:26.775117    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:26.775585 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:26.775127    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:26.775585 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:26.775269    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:26.775585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:26.775308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:26.775585 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:26.775401    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:28.775467 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:28.775287    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:28.775859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:28.775331    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:28.775859 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:28.775539    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:28.775859 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:28.775618    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:28.775859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:28.775334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:28.775859 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:28.775695    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:30.775089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:30.775048    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:30.775570 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:30.775100    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:30.775570 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:30.775100    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:30.775570 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:30.775177    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:30.775570 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:30.775321    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:30.775570 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:30.775416    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:32.437845 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.437810    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:32.438365 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.437860    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:32.438365 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.437936    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:32.438365 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.437956    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:32.438365 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.438015    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:48.437999126 +0000 UTC m=+33.018934205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:32.438365 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.438031    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:15:48.438023189 +0000 UTC m=+33.018958268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:32.538995 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.538959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:32.539202 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.539095    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:32.539202 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.539120    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:32.539202 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.539132    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:32.539202 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.539188    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:48.539173325 +0000 UTC m=+33.120108404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:32.775561 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.775487    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:32.775694 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.775487    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:32.775694 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.775594    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:32.775694 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:32.775493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:32.775694 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.775668    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:32.775842 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:32.775751    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:34.774944 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:34.774903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:34.774944 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:34.774944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:34.775607 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:34.774947    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:34.775607 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:34.775035    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:34.775607 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:34.775121    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:34.775607 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:34.775212    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:36.775800 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:36.775764    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:36.776345 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:36.775764    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:36.776345 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:36.775907    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:36.776345 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:36.775766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:36.776345 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:36.775980    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:36.776345 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:36.776074    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:37.988137 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:37.988104    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" event={"ID":"7fef89a041c43606001c87b66f83a9e8","Type":"ContainerStarted","Data":"423365e04d31ef9fdb96d3c127905f446ed8f8a065e882c38410b10a9c9176c8"}
Jun 11 21:15:37.989690 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:37.989665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9tftw" event={"ID":"3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9","Type":"ContainerStarted","Data":"4278d89c46683d3caf271291eb2dafca9b7fd6081cca666f6863d3a8cfe086cd"}
Jun 11 21:15:37.991156 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:37.991134    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qb7sn" event={"ID":"2a1f7c46-913b-488d-a70c-15c92addac5e","Type":"ContainerStarted","Data":"9ded23ac221c41794faa9e217409d9a76eac6650f38e3c56ec4bf32cf6af05a6"}
Jun 11 21:15:38.002243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.002201    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" podStartSLOduration=22.002188146 podStartE2EDuration="22.002188146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:38.001700096 +0000 UTC m=+22.582635197" watchObservedRunningTime="2026-06-11 21:15:38.002188146 +0000 UTC m=+22.583123247"
Jun 11 21:15:38.030779 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.030690    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9tftw" podStartSLOduration=2.437067362 podStartE2EDuration="23.030674778s" totalImagesPullingTime="20.593607416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:38.030519115 +0000 UTC m=+22.611454215" watchObservedRunningTime="2026-06-11 21:15:38.030674778 +0000 UTC m=+22.611609879"
Jun 11 21:15:38.030919 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.030850    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qb7sn" podStartSLOduration=2.730717438 podStartE2EDuration="23.030846238s" totalImagesPullingTime="20.3001288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:38.016036467 +0000 UTC m=+22.596971587" watchObservedRunningTime="2026-06-11 21:15:38.030846238 +0000 UTC m=+22.611781410"
Jun 11 21:15:38.775399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.775369    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:38.775399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.775399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:38.775672 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.775379    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:38.775672 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:38.775472    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:38.775672 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:38.775546    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:38.775672 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:38.775614    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:38.994551 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.994515    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qp75j" event={"ID":"17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd","Type":"ContainerStarted","Data":"0174e61ce8db10879a6e205486bc9a40f23e2e1fe990cbd2d597c65fd09efa38"}
Jun 11 21:15:38.997687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.997664    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:15:38.997991 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.997964    2570 generic.go:356] "Generic (PLEG): container finished" podID="ae4f0792-6d63-4b81-9cf7-3e1537559f30" containerID="1af877d9d897b707847c89c57d780d4bc692a68d2dff843afd4056c33a38a835" exitCode=1
Jun 11 21:15:38.998113 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"401ec1d45f2f17f9eecc85c151e2e649b66448a950776548ecded4d19619b492"}
Jun 11 21:15:38.998159 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998151    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"9d949ac91135b6d2b193fc405c5e9fb8076c8a31cb7e56399c5e5a994a0b4d58"}
Jun 11 21:15:38.998199 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998183    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"f7ba2b6c82d2bdc087bff4e01fbce4d41f80c2f02ba0d6eeef3e5d4cd262c949"}
Jun 11 21:15:38.998230 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998218    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"c57e246fc76b83b23c6dbf768addd36ede20560de8b38daa4864c92316490f53"}
Jun 11 21:15:38.998315 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerDied","Data":"1af877d9d897b707847c89c57d780d4bc692a68d2dff843afd4056c33a38a835"}
Jun 11 21:15:38.998370 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:38.998318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"705f48cdec09435e227bac4f9fdbb6ea9c0d427c5407de1fb09dfdaef4ba538f"}
Jun 11 21:15:40.002145 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.001986    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="32be2ea05e91d49933c7cf3323aa976996e4117b4b109a272bc44fdfd9f31bd0" exitCode=0
Jun 11 21:15:40.002613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.002080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"32be2ea05e91d49933c7cf3323aa976996e4117b4b109a272bc44fdfd9f31bd0"}
Jun 11 21:15:40.003786 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.003765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8" event={"ID":"8a1583cb-3a0f-4fba-85cb-727953d7f7b3","Type":"ContainerStarted","Data":"9d15c6c406275d78b363a6ce6f4251981e42f238a1b766e7af4738446e9276f5"}
Jun 11 21:15:40.005030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.005008    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-489ln" event={"ID":"e06bc113-442c-42db-9db3-3ea0fa6ce504","Type":"ContainerStarted","Data":"97698aaf4369e85d59a443ad4c4d3335cbe4f20959617b0e65c69eed2000769f"}
Jun 11 21:15:40.006513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.006495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-57b5h" event={"ID":"fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9","Type":"ContainerStarted","Data":"22d4168e14a5f48ae9cae79b5ec2a67964366bdb70cc8a3c3d53508ca651b760"}
Jun 11 21:15:40.008033 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.008012    2570 generic.go:356] "Generic (PLEG): container finished" podID="816c07a2abc1a7623c792353b76fa288" containerID="71ec1f6c490cfed5aee56bd905b70066bdb0a9e121d6a76495e61bbc87313dd1" exitCode=0
Jun 11 21:15:40.008134 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.008058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"816c07a2abc1a7623c792353b76fa288","Type":"ContainerDied","Data":"71ec1f6c490cfed5aee56bd905b70066bdb0a9e121d6a76495e61bbc87313dd1"}
Jun 11 21:15:40.009478 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.009459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2kvgc" event={"ID":"4759d092-5db8-40fe-9f65-32a08a01e89c","Type":"ContainerStarted","Data":"1c56aaab5412c0b83fcd3fbbb8fbc9bc240dbaad5ccd9623e09f1d4a7dbd7d73"}
Jun 11 21:15:40.060987 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.060937    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qp75j" podStartSLOduration=3.782444701 podStartE2EDuration="24.060920545s" totalImagesPullingTime="20.278475844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:39.00844648 +0000 UTC m=+23.589381583" watchObservedRunningTime="2026-06-11 21:15:40.060920545 +0000 UTC m=+24.641855645"
Jun 11 21:15:40.109871 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.109800    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2kvgc" podStartSLOduration=8.207914143 podStartE2EDuration="24.109781149s" totalImagesPullingTime="15.901867006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:40.109221122 +0000 UTC m=+24.690156224" watchObservedRunningTime="2026-06-11 21:15:40.109781149 +0000 UTC m=+24.690716252"
Jun 11 21:15:40.123275 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.123208    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-489ln" podStartSLOduration=3.88829732 podStartE2EDuration="24.123189602s" totalImagesPullingTime="20.234892282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:40.122962871 +0000 UTC m=+24.703897973" watchObservedRunningTime="2026-06-11 21:15:40.123189602 +0000 UTC m=+24.704124706"
Jun 11 21:15:40.137483 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.137419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-57b5h" podStartSLOduration=3.8596466940000003 podStartE2EDuration="24.137404031s" totalImagesPullingTime="20.277757337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:40.13721081 +0000 UTC m=+24.718145911" watchObservedRunningTime="2026-06-11 21:15:40.137404031 +0000 UTC m=+24.718339129"
Jun 11 21:15:40.511397 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.511333    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 11 21:15:40.774726 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.774618    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:15:40.511352306Z","UUID":"47fcdf66-a739-4bc3-98f3-511c688fe604","Handler":null,"Name":"","Endpoint":""}
Jun 11 21:15:40.774912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.774791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:40.774912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.774792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:40.774912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.774904    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:40.774912 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:40.774905    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:40.775075 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:40.774993    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:40.775075 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:40.775060    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:40.776097 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.776077    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 11 21:15:40.776216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:40.776113    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 11 21:15:41.015894 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:41.015864    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:15:41.016458 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:41.016428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"ca71ee16d06af690cb465b15b92e1702ca45b4d698c600114829d493eea0451a"}
Jun 11 21:15:41.018962 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:41.018917    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8" event={"ID":"8a1583cb-3a0f-4fba-85cb-727953d7f7b3","Type":"ContainerStarted","Data":"aba678ba32fc807d6d19c6367e5c55b53c281d631ec5dbb31a2743af956fd645"}
Jun 11 21:15:41.021301 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:41.021270    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"816c07a2abc1a7623c792353b76fa288","Type":"ContainerStarted","Data":"9fddc6c76463cc6b1abd83faf4c4c47921958364127d23e32d2e2683e15e862d"}
Jun 11 21:15:42.022987 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.022773    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:42.023734 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.023712    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:42.024393 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.024352    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:42.024506 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.024484    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2kvgc"
Jun 11 21:15:42.040177 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.040034    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" podStartSLOduration=26.040013767 podStartE2EDuration="26.040013767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:41.039940353 +0000 UTC m=+25.620875454" watchObservedRunningTime="2026-06-11 21:15:42.040013767 +0000 UTC m=+26.620948845"
Jun 11 21:15:42.775423 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.775345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:42.775568 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.775455    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:42.775568 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:42.775460    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:42.775568 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:42.775485    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:42.775568 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:42.775562    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:42.775732 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:42.775649    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:43.029463 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:43.029387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8" event={"ID":"8a1583cb-3a0f-4fba-85cb-727953d7f7b3","Type":"ContainerStarted","Data":"6affd9411f85ddcc58d04ed9d63e024dfb86134dec780a57b95d091f694cb280"}
Jun 11 21:15:43.047676 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:43.047631    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgmd8" podStartSLOduration=4.212362417 podStartE2EDuration="27.04761416s" totalImagesPullingTime="22.835251743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:43.047527815 +0000 UTC m=+27.628462930" watchObservedRunningTime="2026-06-11 21:15:43.04761416 +0000 UTC m=+27.628549262"
Jun 11 21:15:44.775698 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:44.775515    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:44.776303 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:44.775518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:44.776303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:44.775794    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:44.776303 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:44.775540    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:44.776303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:44.775842    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:44.776303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:44.775968    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:45.035401 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.035365    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="dbb90e86f7522fb69f40bf9770bd78589dedd9ae18b3751e48ba520a850cd5c7" exitCode=0
Jun 11 21:15:45.035566 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.035446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"dbb90e86f7522fb69f40bf9770bd78589dedd9ae18b3751e48ba520a850cd5c7"}
Jun 11 21:15:45.038991 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.038970    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:15:45.039317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.039298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"582e6dd65575e8c870c1da6439e383f58846be1b36dc8782ad611dce07d45a45"}
Jun 11 21:15:45.039576 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.039565    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:45.039714 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.039700    2570 scope.go:117] "RemoveContainer" containerID="1af877d9d897b707847c89c57d780d4bc692a68d2dff843afd4056c33a38a835"
Jun 11 21:15:45.056205 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:45.056170    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:46.045064 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.045043    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:15:46.045434 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.045411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" event={"ID":"ae4f0792-6d63-4b81-9cf7-3e1537559f30","Type":"ContainerStarted","Data":"8034c92ba3493e7341fa2676caaa10a0254af01d9a507dd15ad3b52cee10ea46"}
Jun 11 21:15:46.045528 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.045515    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 11 21:15:46.045766 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.045747    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:46.062745 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.062726    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:46.075488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.075427    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq" podStartSLOduration=9.055282133 podStartE2EDuration="30.075408828s" totalImagesPullingTime="21.020126695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:46.075246942 +0000 UTC m=+30.656182062" watchObservedRunningTime="2026-06-11 21:15:46.075408828 +0000 UTC m=+30.656343930"
Jun 11 21:15:46.596493 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.596457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5m7k"]
Jun 11 21:15:46.596644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.596613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:46.596720 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:46.596698    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:46.599295 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.599273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mhf2x"]
Jun 11 21:15:46.599409 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.599367    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:46.599457 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:46.599438    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:46.611494 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.611467    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xmqg8"]
Jun 11 21:15:46.611581 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.611560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:46.611641 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:46.611630    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:46.994951 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:46.994866    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:15:47.049609 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:47.049572    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="6b7a19fe6f02797eaeddc9ea0b56fe2d4d0ab36ec79f52586324b7603c2a04c8" exitCode=0
Jun 11 21:15:47.050031 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:47.049665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"6b7a19fe6f02797eaeddc9ea0b56fe2d4d0ab36ec79f52586324b7603c2a04c8"}
Jun 11 21:15:48.054548 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.054390    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="091d25e31d10154428d71620d96dc53136250205a0fec7aaf94e65660f7c0da0" exitCode=0
Jun 11 21:15:48.054906 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.054472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"091d25e31d10154428d71620d96dc53136250205a0fec7aaf94e65660f7c0da0"}
Jun 11 21:15:48.452582 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.452544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:48.452694 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.452585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:48.452694 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.452676    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:48.452694 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.452681    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:48.452819 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.452740    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:16:20.452723947 +0000 UTC m=+65.033659043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 21:15:48.452819 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.452755    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret podName:10907c69-8e2f-49a6-bf6f-16a0a340b680 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:20.45274908 +0000 UTC m=+65.033684159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret") pod "global-pull-secret-syncer-l5m7k" (UID: "10907c69-8e2f-49a6-bf6f-16a0a340b680") : object "kube-system"/"original-pull-secret" not registered
Jun 11 21:15:48.553842 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.553809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:48.553976 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.553941    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 21:15:48.553976 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.553954    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 21:15:48.553976 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.553963    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2znjl for pod openshift-network-diagnostics/network-check-target-xmqg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:48.554068 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.554004    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl podName:7248b06e-830b-4364-b36e-29591627e6b3 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:20.553993478 +0000 UTC m=+65.134928557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2znjl" (UniqueName: "kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl") pod "network-check-target-xmqg8" (UID: "7248b06e-830b-4364-b36e-29591627e6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 21:15:48.775173 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.775087    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:48.775361 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.775182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:48.775361 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.775295    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5m7k" podUID="10907c69-8e2f-49a6-bf6f-16a0a340b680"
Jun 11 21:15:48.775361 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.775185    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xmqg8" podUID="7248b06e-830b-4364-b36e-29591627e6b3"
Jun 11 21:15:48.775361 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:48.775188    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:48.775488 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:48.775381    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:15:50.775197 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.775123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:15:50.775688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.775123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:15:50.775688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.775234    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:15:50.777835 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.777810    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8l2j\""
Jun 11 21:15:50.777939 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.777848    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 21:15:50.779061 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.779040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9j4lb\""
Jun 11 21:15:50.779192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.779080    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 21:15:50.779192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.779087    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 21:15:50.779192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.779091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 21:15:50.786102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.786086    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeReady"
Jun 11 21:15:50.786217 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.786201    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 11 21:15:50.817783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.817756    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:15:50.821491 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.821473    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.823806 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.823778    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 11 21:15:50.824062 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.824045    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 11 21:15:50.824465 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.824448    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 11 21:15:50.824755 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.824723    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q62t8\""
Jun 11 21:15:50.831900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.831873    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:15:50.834793 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.834771    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 11 21:15:50.835321 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.835296    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nt4g2"]
Jun 11 21:15:50.839875 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.839853    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c4t7g"]
Jun 11 21:15:50.840016 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.839996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:50.842459 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.842434    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 11 21:15:50.842546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.842456    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 11 21:15:50.842546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.842473    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td2lf\""
Jun 11 21:15:50.842767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.842749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:50.844708 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.844690    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 11 21:15:50.845008 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.844980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzclq\""
Jun 11 21:15:50.845096 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.845011    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 11 21:15:50.845096 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.844980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 11 21:15:50.848548 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.848526    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt4g2"]
Jun 11 21:15:50.850996 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.850974    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c4t7g"]
Jun 11 21:15:50.970158 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970122    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-cert\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:50.970158 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970313    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8tw\" (UniqueName: \"kubernetes.io/projected/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-kube-api-access-2c8tw\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:50.970436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1995ac-e412-4f9c-8a33-4fd624133161-config-volume\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6pnk\" (UniqueName: \"kubernetes.io/projected/cb1995ac-e412-4f9c-8a33-4fd624133161-kube-api-access-z6pnk\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xf9w\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:50.970657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:50.970633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb1995ac-e412-4f9c-8a33-4fd624133161-tmp-dir\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.071494 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.071674 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8tw\" (UniqueName: \"kubernetes.io/projected/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-kube-api-access-2c8tw\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:51.071674 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.071674 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1995ac-e412-4f9c-8a33-4fd624133161-config-volume\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6pnk\" (UniqueName: \"kubernetes.io/projected/cb1995ac-e412-4f9c-8a33-4fd624133161-kube-api-access-z6pnk\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xf9w\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.071832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071814    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb1995ac-e412-4f9c-8a33-4fd624133161-tmp-dir\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-cert\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.071889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.071958    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:15:51.072089 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.072026    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:51.572007863 +0000 UTC m=+36.152942942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:15:51.072407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.072350    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb1995ac-e412-4f9c-8a33-4fd624133161-tmp-dir\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.072546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.072520    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb1995ac-e412-4f9c-8a33-4fd624133161-config-volume\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.072757 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.072738    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:15:51.072818 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.072752    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072818 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.072760    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:15:51.072902 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.072812    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072902 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.072822    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.072902 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.072832    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:51.572815626 +0000 UTC m=+36.153750735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:15:51.076131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.076111    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.076240 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.076204    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-cert\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:51.076676 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.076653    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.081540 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.081505    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.081738 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.081720    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xf9w\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.081790 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.081740    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6pnk\" (UniqueName: \"kubernetes.io/projected/cb1995ac-e412-4f9c-8a33-4fd624133161-kube-api-access-z6pnk\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.082175 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.082140    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8tw\" (UniqueName: \"kubernetes.io/projected/c1ae5a40-0556-435a-a739-e04b9a6b3cf0-kube-api-access-2c8tw\") pod \"ingress-canary-c4t7g\" (UID: \"c1ae5a40-0556-435a-a739-e04b9a6b3cf0\") " pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:51.156938 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.156894    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c4t7g"
Jun 11 21:15:51.302302 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.302057    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c4t7g"]
Jun 11 21:15:51.309277 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:15:51.309227    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ae5a40_0556_435a_a739_e04b9a6b3cf0.slice/crio-e2ab1881fcc6199be78101112d401df68ea8b54582b5bccd294f57416ef44571 WatchSource:0}: Error finding container e2ab1881fcc6199be78101112d401df68ea8b54582b5bccd294f57416ef44571: Status 404 returned error can't find the container with id e2ab1881fcc6199be78101112d401df68ea8b54582b5bccd294f57416ef44571
Jun 11 21:15:51.576302 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.576238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:51.576493 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:51.576320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:51.576493 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.576393    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:15:51.576493 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.576455    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:15:51.576493 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.576467    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:52.57645086 +0000 UTC m=+37.157385940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:15:51.576493 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.576470    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:15:51.576713 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:51.576524    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:52.576505833 +0000 UTC m=+37.157440926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:15:52.065996 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:52.065870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c4t7g" event={"ID":"c1ae5a40-0556-435a-a739-e04b9a6b3cf0","Type":"ContainerStarted","Data":"e2ab1881fcc6199be78101112d401df68ea8b54582b5bccd294f57416ef44571"}
Jun 11 21:15:52.585785 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:52.585751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:52.585785 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:52.585791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:52.586001 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:52.585904    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:15:52.586001 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:52.585920    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:15:52.586001 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:52.585936    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:15:52.586001 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:52.585979    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:54.585961986 +0000 UTC m=+39.166897087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:15:52.586001 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:52.585994    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:54.585988189 +0000 UTC m=+39.166923267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:15:54.071460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:54.071420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c4t7g" event={"ID":"c1ae5a40-0556-435a-a739-e04b9a6b3cf0","Type":"ContainerStarted","Data":"cd71a912dddb7d4aa357a8e2efe70c1a039f9985e58f3b5647ebc2397cb3a5dc"}
Jun 11 21:15:54.085635 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:54.085578    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c4t7g" podStartSLOduration=2.27240514 podStartE2EDuration="4.085556809s" totalImagesPullingTime="1.813151669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:54.084804069 +0000 UTC m=+38.665739170" watchObservedRunningTime="2026-06-11 21:15:54.085556809 +0000 UTC m=+38.666491911"
Jun 11 21:15:54.600605 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:54.600561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:54.600794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:54.600621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:54.600794 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:54.600753    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:15:54.600794 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:54.600752    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:15:54.600794 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:54.600772    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:15:54.600996 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:54.600840    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:58.600816738 +0000 UTC m=+43.181751840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:15:54.600996 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:54.600859    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:58.600852573 +0000 UTC m=+43.181787652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:15:55.112537 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:55.112449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:55.209682 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:55.209639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:57.040613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:57.040574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:57.081905 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:57.081874    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="88f7d32f3620b72234487168093455748d4804622e59783fa0c2dddd158ea124" exitCode=0
Jun 11 21:15:57.082065 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:57.081914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"88f7d32f3620b72234487168093455748d4804622e59783fa0c2dddd158ea124"}
Jun 11 21:15:57.104838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:57.104814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:58.087437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.087400    2570 generic.go:356] "Generic (PLEG): container finished" podID="1659540e-4667-4024-886d-2536e3097f09" containerID="d1ab37485ba2b763b0e58690e757e58be0abe95d7761658ea6d23092bff8c6a5" exitCode=0
Jun 11 21:15:58.087834 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.087451    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerDied","Data":"d1ab37485ba2b763b0e58690e757e58be0abe95d7761658ea6d23092bff8c6a5"}
Jun 11 21:15:58.224335 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.224302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:58.273574 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.273535    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:58.634521 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.634478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:15:58.634521 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:58.634525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:15:58.634725 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:58.634640    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:15:58.634725 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:58.634643    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:15:58.634725 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:58.634660    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:15:58.634725 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:58.634709    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:06.634691817 +0000 UTC m=+51.215626915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:15:58.634856 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:15:58.634728    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:06.634719758 +0000 UTC m=+51.215654856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:15:59.092316 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:59.092287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" event={"ID":"1659540e-4667-4024-886d-2536e3097f09","Type":"ContainerStarted","Data":"f6345b8cdc42eda423ca653cc20c8fe9ed6508e52990ad888aa3da1461395c87"}
Jun 11 21:15:59.113492 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:59.113442    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4l7q8" podStartSLOduration=13.756068594 podStartE2EDuration="44.113427231s" totalImagesPullingTime="30.357358637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:59.111939116 +0000 UTC m=+43.692874216" watchObservedRunningTime="2026-06-11 21:15:59.113427231 +0000 UTC m=+43.694362338"
Jun 11 21:15:59.233246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:59.233200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:15:59.334329 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:15:59.334293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:02.212038 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:02.212002    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:02.313408 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:02.313370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:04.321614 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:04.321581    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:04.423460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:04.423434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:05.314396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:05.314354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:05.372599 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:05.372570    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:06.694045 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:06.694006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:16:06.694045 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:06.694049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:16:06.694459 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:06.694165    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:16:06.694459 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:06.694165    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:16:06.694459 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:06.694238    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:22.69422014 +0000 UTC m=+67.275155219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:16:06.694459 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:06.694177    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:16:06.694459 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:06.694328    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:22.694315194 +0000 UTC m=+67.275250273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:16:08.739269 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:08.739231    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:18.066326 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:18.066294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gdgq"
Jun 11 21:16:18.215613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:18.215574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:18.279805 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:18.279773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:19.400686 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:19.400658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:19.458929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:19.458899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:20.497501 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.497446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:16:20.497501 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.497501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:16:20.499881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.499862    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 21:16:20.500127 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.500115    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 21:16:20.507979 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:20.507955    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 21:16:20.508033 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:20.508022    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:17:24.50800463 +0000 UTC m=+129.088939710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : secret "metrics-daemon-secret" not found
Jun 11 21:16:20.511416 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.511397    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10907c69-8e2f-49a6-bf6f-16a0a340b680-original-pull-secret\") pod \"global-pull-secret-syncer-l5m7k\" (UID: \"10907c69-8e2f-49a6-bf6f-16a0a340b680\") " pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:16:20.598655 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.598590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:16:20.601296 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.601278    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 21:16:20.611351 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.611329    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 21:16:20.622697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.622665    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2znjl\" (UniqueName: \"kubernetes.io/projected/7248b06e-830b-4364-b36e-29591627e6b3-kube-api-access-2znjl\") pod \"network-check-target-xmqg8\" (UID: \"7248b06e-830b-4364-b36e-29591627e6b3\") " pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:16:20.786355 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.786270    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5m7k"
Jun 11 21:16:20.794374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.794354    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v8l2j\""
Jun 11 21:16:20.802550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.802528    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:16:20.935775 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.935740    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5m7k"]
Jun 11 21:16:20.941037 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:16:20.940990    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10907c69_8e2f_49a6_bf6f_16a0a340b680.slice/crio-8c66d43f2643845580327294a1f1d8c0c3fb052765eb6bf739321ed4fcd4132b WatchSource:0}: Error finding container 8c66d43f2643845580327294a1f1d8c0c3fb052765eb6bf739321ed4fcd4132b: Status 404 returned error can't find the container with id 8c66d43f2643845580327294a1f1d8c0c3fb052765eb6bf739321ed4fcd4132b
Jun 11 21:16:20.957278 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:20.957229    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xmqg8"]
Jun 11 21:16:20.962187 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:16:20.962157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7248b06e_830b_4364_b36e_29591627e6b3.slice/crio-33ad6ef16082985df63b61831b678fa7057c27d18762838b7240289ec5573a3a WatchSource:0}: Error finding container 33ad6ef16082985df63b61831b678fa7057c27d18762838b7240289ec5573a3a: Status 404 returned error can't find the container with id 33ad6ef16082985df63b61831b678fa7057c27d18762838b7240289ec5573a3a
Jun 11 21:16:21.144122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:21.144082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xmqg8" event={"ID":"7248b06e-830b-4364-b36e-29591627e6b3","Type":"ContainerStarted","Data":"33ad6ef16082985df63b61831b678fa7057c27d18762838b7240289ec5573a3a"}
Jun 11 21:16:21.145099 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:21.145074    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5m7k" event={"ID":"10907c69-8e2f-49a6-bf6f-16a0a340b680","Type":"ContainerStarted","Data":"8c66d43f2643845580327294a1f1d8c0c3fb052765eb6bf739321ed4fcd4132b"}
Jun 11 21:16:21.927208 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:21.927160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:22.024774 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:22.024691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:22.425100 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:22.425059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:22.476057 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:22.476027    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:22.711916 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:22.711828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:16:22.711916 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:22.711879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:16:22.712137 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:22.711995    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:16:22.712137 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:22.711997    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:16:22.712137 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:22.712076    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:54.712054773 +0000 UTC m=+99.292989858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:16:22.712536 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:22.712006    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:16:22.712536 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:22.712505    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:54.712489786 +0000 UTC m=+99.293424870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:16:25.160200 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:25.160166    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xmqg8" event={"ID":"7248b06e-830b-4364-b36e-29591627e6b3","Type":"ContainerStarted","Data":"11fee96f7fea182f41c4a0803b386df2325ecc55cdd1719863be5cd7cdaf4505"}
Jun 11 21:16:25.160675 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:25.160315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:16:25.177472 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:25.177413    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xmqg8" podStartSLOduration=66.992061862 podStartE2EDuration="1m10.177397493s" totalImagesPullingTime="3.185335631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:25.176742477 +0000 UTC m=+69.757677577" watchObservedRunningTime="2026-06-11 21:16:25.177397493 +0000 UTC m=+69.758332635"
Jun 11 21:16:25.232736 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:25.232700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:25.297680 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:25.297645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:26.164498 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:26.164460    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5m7k" event={"ID":"10907c69-8e2f-49a6-bf6f-16a0a340b680","Type":"ContainerStarted","Data":"bbd1626825626a8e73fa7999fbb39166d56edef907f5257309049c47a5f6ba29"}
Jun 11 21:16:42.350462 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:42.350340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:42.451250 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:42.451207    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:42.511861 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:42.511828    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:16:54.735732 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:54.735684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:54.735740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:54.735857    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:54.735912    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:54.735926    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:54.735935    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:17:58.73591883 +0000 UTC m=+163.316853912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:16:54.736303 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:16:54.735984    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:17:58.73596703 +0000 UTC m=+163.316902124 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:16:56.167306 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:56.167271    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xmqg8"
Jun 11 21:16:56.185180 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:16:56.185124    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l5m7k" podStartSLOduration=95.107556824 podStartE2EDuration="1m40.185109171s" totalImagesPullingTime="5.077552347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:26.184878646 +0000 UTC m=+70.765813768" watchObservedRunningTime="2026-06-11 21:16:56.185109171 +0000 UTC m=+100.766044275"
Jun 11 21:17:24.553245 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:17:24.553187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:17:24.553763 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:24.553358    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 21:17:24.553763 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:24.553424    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs podName:1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c nodeName:}" failed. No retries permitted until 2026-06-11 21:19:26.553407769 +0000 UTC m=+251.134342848 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs") pod "network-metrics-daemon-mhf2x" (UID: "1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c") : secret "metrics-daemon-secret" not found
Jun 11 21:17:53.796705 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:53.796660    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mhf2x" podUID="1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c"
Jun 11 21:17:53.837868 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:53.837825    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"
Jun 11 21:17:53.850097 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:53.850051    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nt4g2" podUID="cb1995ac-e412-4f9c-8a33-4fd624133161"
Jun 11 21:17:54.370238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:17:54.370207    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:17:54.370422 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:17:54.370251    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:17:58.793425 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:17:58.793374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:17:58.793425 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:17:58.793417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:17:58.793837 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:58.793522    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 21:17:58.793837 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:58.793525    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 21:17:58.793837 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:58.793593    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls podName:cb1995ac-e412-4f9c-8a33-4fd624133161 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:00.793575979 +0000 UTC m=+285.374511058 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls") pod "dns-default-nt4g2" (UID: "cb1995ac-e412-4f9c-8a33-4fd624133161") : secret "dns-default-metrics-tls" not found
Jun 11 21:17:58.793837 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:58.793534    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb868946-ttr2t: secret "image-registry-tls" not found
Jun 11 21:17:58.793837 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:17:58.793627    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls podName:b2496926-b4a7-40ad-9dd5-d32e2a9e7b53 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:00.793621162 +0000 UTC m=+285.374556242 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls") pod "image-registry-5bb868946-ttr2t" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53") : secret "image-registry-tls" not found
Jun 11 21:18:07.775297 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:18:07.775197    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:18:35.052838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:18:35.052801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:04.477126 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.477094    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kpjnk"]
Jun 11 21:19:04.479844 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.479828    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.481716 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.481692    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"]
Jun 11 21:19:04.482053 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.482036    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 11 21:19:04.482588 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.482565    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 11 21:19:04.482679 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.482617    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 11 21:19:04.483606 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.483576    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2r82l\""
Jun 11 21:19:04.483701 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.483625    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 11 21:19:04.484482 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.484464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.490927 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.490906    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 11 21:19:04.491047 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.490928    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 11 21:19:04.491189 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.491170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 11 21:19:04.491326 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.491229    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dvj9w\""
Jun 11 21:19:04.493367 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.493350    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 11 21:19:04.496572 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.496554    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kpjnk"]
Jun 11 21:19:04.506641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.506616    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"]
Jun 11 21:19:04.559513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-config\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.559687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzmlc\" (UniqueName: \"kubernetes.io/projected/3a0fc190-2032-450c-a96e-efe658efe690-kube-api-access-nzmlc\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.559687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-trusted-ca\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.559687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a0fc190-2032-450c-a96e-efe658efe690-serving-cert\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.559687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.559687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.559678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t77p8\" (UniqueName: \"kubernetes.io/projected/28dec8c8-e072-4263-bc96-033fa375e3c3-kube-api-access-t77p8\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.572304 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.572274    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gnppz"]
Jun 11 21:19:04.575166 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.575142    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"]
Jun 11 21:19:04.575324 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.575290    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.577808 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.577789    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 11 21:19:04.577932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.577794    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"]
Jun 11 21:19:04.577932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.577860    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"
Jun 11 21:19:04.578102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.578083    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 11 21:19:04.579623 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.579604    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7zxb4\""
Jun 11 21:19:04.579831 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.579817    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x4tl9\""
Jun 11 21:19:04.580476 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.580463    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fp442"]
Jun 11 21:19:04.580592 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.580578    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.582985 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.582965    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 11 21:19:04.583167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.583150    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 11 21:19:04.583277 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.583235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.583348 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.583222    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 11 21:19:04.583402 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.583309    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 11 21:19:04.583691 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.583675    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2jhtn\""
Jun 11 21:19:04.586248 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.586229    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 11 21:19:04.586950 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.586823    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2gpfv\""
Jun 11 21:19:04.587043 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.586972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 11 21:19:04.587100 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.587086    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 11 21:19:04.587340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.587324    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 11 21:19:04.588413 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.588351    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"]
Jun 11 21:19:04.589663 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.589634    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gnppz"]
Jun 11 21:19:04.593881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.593819    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"]
Jun 11 21:19:04.594818 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.594798    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fp442"]
Jun 11 21:19:04.596018 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.595762    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 11 21:19:04.660076 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660076 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnp5\" (UniqueName: \"kubernetes.io/projected/208e16c1-b8e1-475e-ae2d-e62116f8ab3f-kube-api-access-9bnp5\") pod \"network-check-source-6947749cfc-lqv8n\" (UID: \"208e16c1-b8e1-475e-ae2d-e62116f8ab3f\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-config\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-tmp\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-snapshots\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzmlc\" (UniqueName: \"kubernetes.io/projected/3a0fc190-2032-450c-a96e-efe658efe690-kube-api-access-nzmlc\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660281    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6739aa17-7177-4536-b99e-7fca6ddd80c3-serving-cert\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac169553-1997-44de-a37a-f5240da6e15b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.660443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq25s\" (UniqueName: \"kubernetes.io/projected/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-kube-api-access-gq25s\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-config\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-trusted-ca\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a0fc190-2032-450c-a96e-efe658efe690-serving-cert\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtv8\" (UniqueName: \"kubernetes.io/projected/6739aa17-7177-4536-b99e-7fca6ddd80c3-kube-api-access-sdtv8\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.660743 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.660672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t77p8\" (UniqueName: \"kubernetes.io/projected/28dec8c8-e072-4263-bc96-033fa375e3c3-kube-api-access-t77p8\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.661058 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:04.660845    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 21:19:04.661058 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:04.660929    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls podName:28dec8c8-e072-4263-bc96-033fa375e3c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:05.160908054 +0000 UTC m=+229.741843134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls") pod "cluster-samples-operator-9547488fd-xpwjd" (UID: "28dec8c8-e072-4263-bc96-033fa375e3c3") : secret "samples-operator-tls" not found
Jun 11 21:19:04.661271 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.661238    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-config\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.661579 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.661562    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a0fc190-2032-450c-a96e-efe658efe690-trusted-ca\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.663059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.663037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a0fc190-2032-450c-a96e-efe658efe690-serving-cert\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.673214 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.673178    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzmlc\" (UniqueName: \"kubernetes.io/projected/3a0fc190-2032-450c-a96e-efe658efe690-kube-api-access-nzmlc\") pod \"console-operator-5dbbb5d744-kpjnk\" (UID: \"3a0fc190-2032-450c-a96e-efe658efe690\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.673859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.673838    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t77p8\" (UniqueName: \"kubernetes.io/projected/28dec8c8-e072-4263-bc96-033fa375e3c3-kube-api-access-t77p8\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:04.722529 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.722495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:04.761712 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtv8\" (UniqueName: \"kubernetes.io/projected/6739aa17-7177-4536-b99e-7fca6ddd80c3-kube-api-access-sdtv8\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.761712 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.761712 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.761948 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnp5\" (UniqueName: \"kubernetes.io/projected/208e16c1-b8e1-475e-ae2d-e62116f8ab3f-kube-api-access-9bnp5\") pod \"network-check-source-6947749cfc-lqv8n\" (UID: \"208e16c1-b8e1-475e-ae2d-e62116f8ab3f\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"
Jun 11 21:19:04.761948 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-config\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.761948 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-tmp\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.761948 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-snapshots\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.761948 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6739aa17-7177-4536-b99e-7fca6ddd80c3-serving-cert\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.762167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.761982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac169553-1997-44de-a37a-f5240da6e15b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.762167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.762167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq25s\" (UniqueName: \"kubernetes.io/projected/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-kube-api-access-gq25s\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.762167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.762384 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:04.762230    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:04.762384 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:04.762331    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:05.262310926 +0000 UTC m=+229.843246005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:04.762511 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-config\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.762593 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762494    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.762722 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762654    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-snapshots\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.762722 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762714    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6739aa17-7177-4536-b99e-7fca6ddd80c3-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.762840 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.762798    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6739aa17-7177-4536-b99e-7fca6ddd80c3-tmp\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.763125 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.763100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac169553-1997-44de-a37a-f5240da6e15b-nginx-conf\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:04.764551 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.764531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6739aa17-7177-4536-b99e-7fca6ddd80c3-serving-cert\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.764831 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.764816    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.770470 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.770446    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq25s\" (UniqueName: \"kubernetes.io/projected/dc4206ba-184c-4bdf-947f-d4c6e553eb6e-kube-api-access-gq25s\") pod \"service-ca-operator-7ccbfd59dc-r2ctj\" (UID: \"dc4206ba-184c-4bdf-947f-d4c6e553eb6e\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.771009 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.770989    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtv8\" (UniqueName: \"kubernetes.io/projected/6739aa17-7177-4536-b99e-7fca6ddd80c3-kube-api-access-sdtv8\") pod \"insights-operator-5bbd86d6bd-fp442\" (UID: \"6739aa17-7177-4536-b99e-7fca6ddd80c3\") " pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.771230 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.771211    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnp5\" (UniqueName: \"kubernetes.io/projected/208e16c1-b8e1-475e-ae2d-e62116f8ab3f-kube-api-access-9bnp5\") pod \"network-check-source-6947749cfc-lqv8n\" (UID: \"208e16c1-b8e1-475e-ae2d-e62116f8ab3f\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"
Jun 11 21:19:04.789436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.789410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:04.823440 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.823407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:04.893867 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.893831    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"
Jun 11 21:19:04.900996 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.900970    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"
Jun 11 21:19:04.906056 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.906026    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442"
Jun 11 21:19:04.917374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:04.917343    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kpjnk"]
Jun 11 21:19:04.921812 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:04.921781    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0fc190_2032_450c_a96e_efe658efe690.slice/crio-856805fbcf42d7ba88ea50bd43c2c3460f85c129ad4d429f038c138aacbc3306 WatchSource:0}: Error finding container 856805fbcf42d7ba88ea50bd43c2c3460f85c129ad4d429f038c138aacbc3306: Status 404 returned error can't find the container with id 856805fbcf42d7ba88ea50bd43c2c3460f85c129ad4d429f038c138aacbc3306
Jun 11 21:19:05.039139 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.039056    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n"]
Jun 11 21:19:05.042495 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:05.042454    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208e16c1_b8e1_475e_ae2d_e62116f8ab3f.slice/crio-a4274f018fa6db70b2e6c46f4683c8e8a26daf508ef6b4c237194ab4626a1ce4 WatchSource:0}: Error finding container a4274f018fa6db70b2e6c46f4683c8e8a26daf508ef6b4c237194ab4626a1ce4: Status 404 returned error can't find the container with id a4274f018fa6db70b2e6c46f4683c8e8a26daf508ef6b4c237194ab4626a1ce4
Jun 11 21:19:05.056545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.056520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-fp442"]
Jun 11 21:19:05.060187 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:05.060163    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6739aa17_7177_4536_b99e_7fca6ddd80c3.slice/crio-6425e499c71829e5936245572f44a4a100bc96fcfe8e76a73ff8e2465a3fe174 WatchSource:0}: Error finding container 6425e499c71829e5936245572f44a4a100bc96fcfe8e76a73ff8e2465a3fe174: Status 404 returned error can't find the container with id 6425e499c71829e5936245572f44a4a100bc96fcfe8e76a73ff8e2465a3fe174
Jun 11 21:19:05.070549 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.070523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj"]
Jun 11 21:19:05.073660 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:05.073638    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4206ba_184c_4bdf_947f_d4c6e553eb6e.slice/crio-8f14f9d1105dbc03e12111672fdcbd6e6fe41abadbe3867c110a10a6ad14db13 WatchSource:0}: Error finding container 8f14f9d1105dbc03e12111672fdcbd6e6fe41abadbe3867c110a10a6ad14db13: Status 404 returned error can't find the container with id 8f14f9d1105dbc03e12111672fdcbd6e6fe41abadbe3867c110a10a6ad14db13
Jun 11 21:19:05.166485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.166443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:05.166650 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:05.166592    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 21:19:05.166703 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:05.166651    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls podName:28dec8c8-e072-4263-bc96-033fa375e3c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:06.166636116 +0000 UTC m=+230.747571199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls") pod "cluster-samples-operator-9547488fd-xpwjd" (UID: "28dec8c8-e072-4263-bc96-033fa375e3c3") : secret "samples-operator-tls" not found
Jun 11 21:19:05.267756 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.267723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:05.267938 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:05.267883    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:05.267982 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:05.267948    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:06.267932424 +0000 UTC m=+230.848867503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:05.538873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.538832    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442" event={"ID":"6739aa17-7177-4536-b99e-7fca6ddd80c3","Type":"ContainerStarted","Data":"6425e499c71829e5936245572f44a4a100bc96fcfe8e76a73ff8e2465a3fe174"}
Jun 11 21:19:05.540856 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.540827    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj" event={"ID":"dc4206ba-184c-4bdf-947f-d4c6e553eb6e","Type":"ContainerStarted","Data":"8f14f9d1105dbc03e12111672fdcbd6e6fe41abadbe3867c110a10a6ad14db13"}
Jun 11 21:19:05.542930 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.542491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n" event={"ID":"208e16c1-b8e1-475e-ae2d-e62116f8ab3f","Type":"ContainerStarted","Data":"1230e6ac45a3f64163829b846df69117a26c11b6bc634a7c015ba27539040652"}
Jun 11 21:19:05.542930 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.542537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n" event={"ID":"208e16c1-b8e1-475e-ae2d-e62116f8ab3f","Type":"ContainerStarted","Data":"a4274f018fa6db70b2e6c46f4683c8e8a26daf508ef6b4c237194ab4626a1ce4"}
Jun 11 21:19:05.544098 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.544068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" event={"ID":"3a0fc190-2032-450c-a96e-efe658efe690","Type":"ContainerStarted","Data":"856805fbcf42d7ba88ea50bd43c2c3460f85c129ad4d429f038c138aacbc3306"}
Jun 11 21:19:05.568684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:05.568619    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-lqv8n" podStartSLOduration=1.5685951870000001 podStartE2EDuration="1.568595187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:05.566654422 +0000 UTC m=+230.147589525" watchObservedRunningTime="2026-06-11 21:19:05.568595187 +0000 UTC m=+230.149530288"
Jun 11 21:19:06.177001 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:06.176962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:06.177201 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:06.177104    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 21:19:06.177287 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:06.177200    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls podName:28dec8c8-e072-4263-bc96-033fa375e3c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:08.177162194 +0000 UTC m=+232.758097278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls") pod "cluster-samples-operator-9547488fd-xpwjd" (UID: "28dec8c8-e072-4263-bc96-033fa375e3c3") : secret "samples-operator-tls" not found
Jun 11 21:19:06.277629 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:06.277587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:06.277858 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:06.277842    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:06.277924 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:06.277912    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:08.277891563 +0000 UTC m=+232.858826646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:06.668987 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:06.668942    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:06.724560 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:06.724518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:07.715508 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:07.715469    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:07.808977 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:07.808942    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:08.195005 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.194965    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:08.195186 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:08.195139    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 21:19:08.195249 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:08.195218    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls podName:28dec8c8-e072-4263-bc96-033fa375e3c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:12.195197763 +0000 UTC m=+236.776132865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls") pod "cluster-samples-operator-9547488fd-xpwjd" (UID: "28dec8c8-e072-4263-bc96-033fa375e3c3") : secret "samples-operator-tls" not found
Jun 11 21:19:08.295901 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.295799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:08.296052 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:08.295971    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:08.296107 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:08.296055    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:12.296034806 +0000 UTC m=+236.876969902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:08.560562 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.560455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442" event={"ID":"6739aa17-7177-4536-b99e-7fca6ddd80c3","Type":"ContainerStarted","Data":"394b21a56ff13b4a38eb76e136c8dc40b6bf6e977b3743bdec66167e9546893f"}
Jun 11 21:19:08.562015 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.561980    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj" event={"ID":"dc4206ba-184c-4bdf-947f-d4c6e553eb6e","Type":"ContainerStarted","Data":"38a2d38ae6e3dacafd7009b747bb7c909a952635dee54c36f8b957fff875e8ad"}
Jun 11 21:19:08.563681 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.563659    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/0.log"
Jun 11 21:19:08.563800 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.563704    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a0fc190-2032-450c-a96e-efe658efe690" containerID="724c1120c79360871a843bdc65c4db82abf09deeb63e1ecef1971fe64215fd32" exitCode=255
Jun 11 21:19:08.563800 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.563733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" event={"ID":"3a0fc190-2032-450c-a96e-efe658efe690","Type":"ContainerDied","Data":"724c1120c79360871a843bdc65c4db82abf09deeb63e1ecef1971fe64215fd32"}
Jun 11 21:19:08.563934 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.563921    2570 scope.go:117] "RemoveContainer" containerID="724c1120c79360871a843bdc65c4db82abf09deeb63e1ecef1971fe64215fd32"
Jun 11 21:19:08.577000 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.576953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442" podStartSLOduration=1.567177818 podStartE2EDuration="4.576937644s" totalImagesPullingTime="3.009759826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:08.575830106 +0000 UTC m=+233.156765208" watchObservedRunningTime="2026-06-11 21:19:08.576937644 +0000 UTC m=+233.157872745"
Jun 11 21:19:08.608549 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.608500    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj" podStartSLOduration=1.6159393880000001 podStartE2EDuration="4.608483105s" totalImagesPullingTime="2.992543717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:08.606844583 +0000 UTC m=+233.187779708" watchObservedRunningTime="2026-06-11 21:19:08.608483105 +0000 UTC m=+233.189418205"
Jun 11 21:19:08.705635 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.705599    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"]
Jun 11 21:19:08.709078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.709056    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"
Jun 11 21:19:08.711569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.711540    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9vsfp\""
Jun 11 21:19:08.711696 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.711611    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 11 21:19:08.711696 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.711540    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 11 21:19:08.716825 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.716797    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"]
Jun 11 21:19:08.744747 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.744715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:08.800787 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.800742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mdmg\" (UniqueName: \"kubernetes.io/projected/9840eb29-6cd3-4cd6-8f95-8bffd672a9ce-kube-api-access-9mdmg\") pod \"migrator-d4bcd4867-5sxqx\" (UID: \"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"
Jun 11 21:19:08.845938 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.845906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:08.901146 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.901108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mdmg\" (UniqueName: \"kubernetes.io/projected/9840eb29-6cd3-4cd6-8f95-8bffd672a9ce-kube-api-access-9mdmg\") pod \"migrator-d4bcd4867-5sxqx\" (UID: \"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"
Jun 11 21:19:08.910018 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:08.909987    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mdmg\" (UniqueName: \"kubernetes.io/projected/9840eb29-6cd3-4cd6-8f95-8bffd672a9ce-kube-api-access-9mdmg\") pod \"migrator-d4bcd4867-5sxqx\" (UID: \"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"
Jun 11 21:19:09.040247 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.040198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"
Jun 11 21:19:09.198835 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.198805    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9gtd"]
Jun 11 21:19:09.202087 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:09.202060    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9840eb29_6cd3_4cd6_8f95_8bffd672a9ce.slice/crio-00907585f4c58e138ff09d9221f0ed5e1adbb922fecf1f8676cb476a04557095 WatchSource:0}: Error finding container 00907585f4c58e138ff09d9221f0ed5e1adbb922fecf1f8676cb476a04557095: Status 404 returned error can't find the container with id 00907585f4c58e138ff09d9221f0ed5e1adbb922fecf1f8676cb476a04557095
Jun 11 21:19:09.203217 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.203196    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx"]
Jun 11 21:19:09.203347 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.203329    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.206376 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.206355    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qj9z\""
Jun 11 21:19:09.206649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.206520    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 11 21:19:09.207023 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.207004    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 11 21:19:09.217607 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.217585    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9gtd"]
Jun 11 21:19:09.239512 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.239484    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:09.305985 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.305948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e83b37c-9afe-414f-a350-ef929353f64b-crio-socket\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.305985 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.305996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.306236 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.306108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e83b37c-9afe-414f-a350-ef929353f64b-data-volume\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.306236 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.306222    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.306377 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.306288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqfx2\" (UniqueName: \"kubernetes.io/projected/1e83b37c-9afe-414f-a350-ef929353f64b-kube-api-access-bqfx2\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.310747 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.310709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:09.407428 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e83b37c-9afe-414f-a350-ef929353f64b-crio-socket\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407428 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407428 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e83b37c-9afe-414f-a350-ef929353f64b-data-volume\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqfx2\" (UniqueName: \"kubernetes.io/projected/1e83b37c-9afe-414f-a350-ef929353f64b-kube-api-access-bqfx2\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407483    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e83b37c-9afe-414f-a350-ef929353f64b-crio-socket\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.407520    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.407558    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.407597    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:09.907576283 +0000 UTC m=+234.488511365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:09.407671 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.407620    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:09.90760442 +0000 UTC m=+234.488539518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : configmap "kube-rbac-proxy" not found
Jun 11 21:19:09.407927 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.407822    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e83b37c-9afe-414f-a350-ef929353f64b-data-volume\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.419009 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.418980    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqfx2\" (UniqueName: \"kubernetes.io/projected/1e83b37c-9afe-414f-a350-ef929353f64b-kube-api-access-bqfx2\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.569510 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.569477    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:19:09.569928 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.569911    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/0.log"
Jun 11 21:19:09.570018 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.569955    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a0fc190-2032-450c-a96e-efe658efe690" containerID="5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed" exitCode=255
Jun 11 21:19:09.570075 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.570034    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" event={"ID":"3a0fc190-2032-450c-a96e-efe658efe690","Type":"ContainerDied","Data":"5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed"}
Jun 11 21:19:09.570127 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.570100    2570 scope.go:117] "RemoveContainer" containerID="724c1120c79360871a843bdc65c4db82abf09deeb63e1ecef1971fe64215fd32"
Jun 11 21:19:09.570362 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.570323    2570 scope.go:117] "RemoveContainer" containerID="5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed"
Jun 11 21:19:09.570556 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.570536    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kpjnk_openshift-console-operator(3a0fc190-2032-450c-a96e-efe658efe690)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" podUID="3a0fc190-2032-450c-a96e-efe658efe690"
Jun 11 21:19:09.571382 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.571332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx" event={"ID":"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce","Type":"ContainerStarted","Data":"00907585f4c58e138ff09d9221f0ed5e1adbb922fecf1f8676cb476a04557095"}
Jun 11 21:19:09.912547 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.912508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.913061 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:09.912599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:09.913061 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.912638    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 21:19:09.913061 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.912710    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:10.912691457 +0000 UTC m=+235.493626551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : configmap "kube-rbac-proxy" not found
Jun 11 21:19:09.913061 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.912720    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:09.913061 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:09.912754    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:10.91274383 +0000 UTC m=+235.493678909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:10.042712 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.042680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.166564 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.166481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.422885 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.422798    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.524206 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.524167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.576678 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.576648    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:19:10.577055 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.577038    2570 scope.go:117] "RemoveContainer" containerID="5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed"
Jun 11 21:19:10.577235 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:10.577215    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kpjnk_openshift-console-operator(3a0fc190-2032-450c-a96e-efe658efe690)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" podUID="3a0fc190-2032-450c-a96e-efe658efe690"
Jun 11 21:19:10.578466 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.578443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx" event={"ID":"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce","Type":"ContainerStarted","Data":"716b4c2f22ee429b725419e4078d169510c58e40b5aa0939b744fe0a7ec89083"}
Jun 11 21:19:10.578557 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.578513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx" event={"ID":"9840eb29-6cd3-4cd6-8f95-8bffd672a9ce","Type":"ContainerStarted","Data":"78873d42c9bb46658cdc7a11bd738bc0ee2ab1a1907d461177b5e9ff728ccef2"}
Jun 11 21:19:10.611474 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.611423    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-5sxqx" podStartSLOduration=1.426837614 podStartE2EDuration="2.611406229s" totalImagesPullingTime="1.184568615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:10.610440278 +0000 UTC m=+235.191375391" watchObservedRunningTime="2026-06-11 21:19:10.611406229 +0000 UTC m=+235.192341330"
Jun 11 21:19:10.682189 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.682097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.784769 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.784730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:10.920539 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.920497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:10.920927 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:10.920592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:10.920927 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:10.920656    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 21:19:10.920927 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:10.920657    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:10.920927 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:10.920722    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:12.920705007 +0000 UTC m=+237.501640085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:10.920927 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:10.920738    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:12.920730681 +0000 UTC m=+237.501665760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : configmap "kube-rbac-proxy" not found
Jun 11 21:19:11.768536 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:11.768511    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-489ln_e06bc113-442c-42db-9db3-3ea0fa6ce504/dns-node-resolver/0.log"
Jun 11 21:19:12.232228 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.232189    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:12.232637 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.232365    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 11 21:19:12.232637 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.232440    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls podName:28dec8c8-e072-4263-bc96-033fa375e3c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:20.232425504 +0000 UTC m=+244.813360585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls") pod "cluster-samples-operator-9547488fd-xpwjd" (UID: "28dec8c8-e072-4263-bc96-033fa375e3c3") : secret "samples-operator-tls" not found
Jun 11 21:19:12.267810 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.267774    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-k99cn"]
Jun 11 21:19:12.270958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.270938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.273552 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.273532    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 11 21:19:12.274594 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.274574    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 11 21:19:12.274715 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.274616    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qwk5j\""
Jun 11 21:19:12.274715 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.274623    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 11 21:19:12.274820 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.274622    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 11 21:19:12.280610 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.280587    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-k99cn"]
Jun 11 21:19:12.305329 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.305293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:12.333122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.333092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:12.333273 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.333239    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:12.333316 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.333309    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:20.333295126 +0000 UTC m=+244.914230206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:12.434229 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.434199    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcm9t\" (UniqueName: \"kubernetes.io/projected/20201dae-1d8c-4024-b95d-1d1872aa3b64-kube-api-access-lcm9t\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.434435 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.434299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-key\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.434435 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.434378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-cabundle\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.535164 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.535061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-key\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.535348 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.535147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-cabundle\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.535348 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.535214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcm9t\" (UniqueName: \"kubernetes.io/projected/20201dae-1d8c-4024-b95d-1d1872aa3b64-kube-api-access-lcm9t\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.535925 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.535904    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-cabundle\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.537708 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.537689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/20201dae-1d8c-4024-b95d-1d1872aa3b64-signing-key\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.544510 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.544481    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcm9t\" (UniqueName: \"kubernetes.io/projected/20201dae-1d8c-4024-b95d-1d1872aa3b64-kube-api-access-lcm9t\") pod \"service-ca-7b994bc59-k99cn\" (UID: \"20201dae-1d8c-4024-b95d-1d1872aa3b64\") " pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.580132 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.580101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-k99cn"
Jun 11 21:19:12.715037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.715000    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-k99cn"]
Jun 11 21:19:12.718142 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:12.718113    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20201dae_1d8c_4024_b95d_1d1872aa3b64.slice/crio-daffa99be6b9cd5f35a5b40c099d506d39f242a29bb87904c71041ceda1322ab WatchSource:0}: Error finding container daffa99be6b9cd5f35a5b40c099d506d39f242a29bb87904c71041ceda1322ab: Status 404 returned error can't find the container with id daffa99be6b9cd5f35a5b40c099d506d39f242a29bb87904c71041ceda1322ab
Jun 11 21:19:12.769653 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.769630    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-57b5h_fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9/node-ca/0.log"
Jun 11 21:19:12.938324 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.938285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:12.938697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:12.938378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:12.938697 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.938414    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 21:19:12.938697 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.938482    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:12.938697 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.938489    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:16.938469058 +0000 UTC m=+241.519404142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : configmap "kube-rbac-proxy" not found
Jun 11 21:19:12.938697 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:12.938515    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:16.938505896 +0000 UTC m=+241.519440975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:13.364769 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.364735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:13.568626 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.568593    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c4t7g_c1ae5a40-0556-435a-a739-e04b9a6b3cf0/serve-healthcheck-canary/0.log"
Jun 11 21:19:13.589976 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.589941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-k99cn" event={"ID":"20201dae-1d8c-4024-b95d-1d1872aa3b64","Type":"ContainerStarted","Data":"e8d8690e27b8ecd6a3e26c5694c8878d5bb7a65803e1785050a02c8644e5cac5"}
Jun 11 21:19:13.590147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.589994    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-k99cn" event={"ID":"20201dae-1d8c-4024-b95d-1d1872aa3b64","Type":"ContainerStarted","Data":"daffa99be6b9cd5f35a5b40c099d506d39f242a29bb87904c71041ceda1322ab"}
Jun 11 21:19:13.609311 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.609233    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-k99cn" podStartSLOduration=1.609216182 podStartE2EDuration="1.609216182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:13.607657225 +0000 UTC m=+238.188592338" watchObservedRunningTime="2026-06-11 21:19:13.609216182 +0000 UTC m=+238.190151304"
Jun 11 21:19:13.928271 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:13.928206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:14.028146 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.028112    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:14.128897 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.128864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:14.169980 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.169947    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-5sxqx_9840eb29-6cd3-4cd6-8f95-8bffd672a9ce/migrator/0.log"
Jun 11 21:19:14.229896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.229779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:14.306007 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.305971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:14.376487 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.376455    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-5sxqx_9840eb29-6cd3-4cd6-8f95-8bffd672a9ce/graceful-termination/0.log"
Jun 11 21:19:14.789775 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.789736    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:14.789956 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.789818    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:14.790181 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:14.790169    2570 scope.go:117] "RemoveContainer" containerID="5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed"
Jun 11 21:19:14.790366 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:14.790347    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kpjnk_openshift-console-operator(3a0fc190-2032-450c-a96e-efe658efe690)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" podUID="3a0fc190-2032-450c-a96e-efe658efe690"
Jun 11 21:19:15.423014 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:15.422981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:15.619857 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:15.619816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:15.817742 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:15.817636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:16.019624 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:16.019596    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:16.105714 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:16.105676    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:16.222915 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:16.222877    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:16.971514 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:16.971473    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:16.971911 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:16.971558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:16.971911 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:16.971593    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 21:19:16.971911 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:16.971659    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:24.971644493 +0000 UTC m=+249.552579572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : configmap "kube-rbac-proxy" not found
Jun 11 21:19:16.971911 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:16.971686    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:16.971911 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:16.971736    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls podName:1e83b37c-9afe-414f-a350-ef929353f64b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:24.971721209 +0000 UTC m=+249.552656290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9gtd" (UID: "1e83b37c-9afe-414f-a350-ef929353f64b") : secret "insights-runtime-extractor-tls" not found
Jun 11 21:19:17.022817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:17.022766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:17.616516 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:17.616479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:17.715004 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:17.714958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:17.819871 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:17.819838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:17.921913 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:17.921801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:18.022216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:18.022172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:18.445340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:18.445292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:19.234850 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:19.234821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:19.480640 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:19.480580    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:19.841387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:19.841352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:20.022431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.022395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:20.299667 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.299566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:20.302194 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.302158    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/28dec8c8-e072-4263-bc96-033fa375e3c3-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-xpwjd\" (UID: \"28dec8c8-e072-4263-bc96-033fa375e3c3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:20.397478 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.397446    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dvj9w\""
Jun 11 21:19:20.400859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.400830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:20.401002 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:20.400984    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 11 21:19:20.401088 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:20.401075    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert podName:ac169553-1997-44de-a37a-f5240da6e15b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:36.401051392 +0000 UTC m=+260.981986478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-gnppz" (UID: "ac169553-1997-44de-a37a-f5240da6e15b") : secret "networking-console-plugin-cert" not found
Jun 11 21:19:20.405831 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.405813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"
Jun 11 21:19:20.421455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.421429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:20.524897 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.524863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:20.549914 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.549826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd"]
Jun 11 21:19:20.614176 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.614144    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd" event={"ID":"28dec8c8-e072-4263-bc96-033fa375e3c3","Type":"ContainerStarted","Data":"86d958da1ed75a21decfe3fd42fc0980a32a195107cda9a22afa243c0523fe46"}
Jun 11 21:19:20.770893 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:20.770857    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:21.027433 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:21.027399    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:21.417395 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:21.417363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:21.818406 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:21.818305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:22.017683 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:22.017642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:22.621824 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:22.621728    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:22.623162 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:22.623135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd" event={"ID":"28dec8c8-e072-4263-bc96-033fa375e3c3","Type":"ContainerStarted","Data":"d6facf0028019d635a31d9c7a6f06a7d4b71257a2b3cd1e618fbf1d8ac128f31"}
Jun 11 21:19:22.623293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:22.623195    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd" event={"ID":"28dec8c8-e072-4263-bc96-033fa375e3c3","Type":"ContainerStarted","Data":"842b80c214a40248a4e154a063cfd6cf48ad928a19ec8aebe973ce556b5e4251"}
Jun 11 21:19:22.643638 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:22.641030    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-xpwjd" podStartSLOduration=16.920969466 podStartE2EDuration="18.64100737s" totalImagesPullingTime="1.720037904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:22.63917467 +0000 UTC m=+247.220109761" watchObservedRunningTime="2026-06-11 21:19:22.64100737 +0000 UTC m=+247.221942472"
Jun 11 21:19:23.016462 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:23.016378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:23.441887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:23.441851    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:23.823943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:23.823904    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:24.213979 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:24.213899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:24.423220 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:24.423186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:24.537866 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:24.537776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:24.621868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:24.621833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:25.036324 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.036286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:25.036721 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.036358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:25.036838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.036807    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e83b37c-9afe-414f-a350-ef929353f64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:25.038817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.038795    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e83b37c-9afe-414f-a350-ef929353f64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9gtd\" (UID: \"1e83b37c-9afe-414f-a350-ef929353f64b\") " pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:25.118692 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.118659    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qj9z\""
Jun 11 21:19:25.126678 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.126650    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9gtd"
Jun 11 21:19:25.265473 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.265438    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9gtd"]
Jun 11 21:19:25.269994 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:25.269961    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e83b37c_9afe_414f_a350_ef929353f64b.slice/crio-4c9af176fa9ba35ccb26d82785bcc3e8fe7ec5046264f8912e99e5694bfec32f WatchSource:0}: Error finding container 4c9af176fa9ba35ccb26d82785bcc3e8fe7ec5046264f8912e99e5694bfec32f: Status 404 returned error can't find the container with id 4c9af176fa9ba35ccb26d82785bcc3e8fe7ec5046264f8912e99e5694bfec32f
Jun 11 21:19:25.633278 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:25.633232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9gtd" event={"ID":"1e83b37c-9afe-414f-a350-ef929353f64b","Type":"ContainerStarted","Data":"4c9af176fa9ba35ccb26d82785bcc3e8fe7ec5046264f8912e99e5694bfec32f"}
Jun 11 21:19:26.651833 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.651794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:19:26.654582 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.654558    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c-metrics-certs\") pod \"network-metrics-daemon-mhf2x\" (UID: \"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c\") " pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:19:26.679191 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.679158    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9j4lb\""
Jun 11 21:19:26.686789 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.686753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhf2x"
Jun 11 21:19:26.776399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.776003    2570 scope.go:117] "RemoveContainer" containerID="5e14a7829049fd28f6e65639ce9a77a9eaed2022f337f11977b99895fa29d2ed"
Jun 11 21:19:26.826509 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:26.826462    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mhf2x"]
Jun 11 21:19:26.829929 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:26.829900    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae9a1bb_3bf6_40fd_8d0b_044e0b7e998c.slice/crio-d5a9ad8a8c3289216f5021df405e7d97803d7fd35a26161acafcd7e0721db4e0 WatchSource:0}: Error finding container d5a9ad8a8c3289216f5021df405e7d97803d7fd35a26161acafcd7e0721db4e0: Status 404 returned error can't find the container with id d5a9ad8a8c3289216f5021df405e7d97803d7fd35a26161acafcd7e0721db4e0
Jun 11 21:19:27.038556 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.038481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:27.139572 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.139535    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:27.642862 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.642829    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:19:27.643018 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.642929    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" event={"ID":"3a0fc190-2032-450c-a96e-efe658efe690","Type":"ContainerStarted","Data":"0d0ed5162072606ba4b99bca543bc9a4dedd9b651bfd41a500618aba08f1b3f4"}
Jun 11 21:19:27.643396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.643372    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:27.644850 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.644822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhf2x" event={"ID":"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c","Type":"ContainerStarted","Data":"d5a9ad8a8c3289216f5021df405e7d97803d7fd35a26161acafcd7e0721db4e0"}
Jun 11 21:19:27.653353 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.653324    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk"
Jun 11 21:19:27.664448 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.664381    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-kpjnk" podStartSLOduration=20.524403357 podStartE2EDuration="23.664363479s" totalImagesPullingTime="3.139960122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:27.662215775 +0000 UTC m=+252.243150877" watchObservedRunningTime="2026-06-11 21:19:27.664363479 +0000 UTC m=+252.245298580"
Jun 11 21:19:27.826005 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.825951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:27.929118 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:27.928985    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:28.128089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:28.128041    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:28.335181 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:28.335150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:28.552482 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:28.552444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:28.662189 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:28.662110    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:28.927599 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:28.927517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:29.010899 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.010864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:29.312405 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.312381    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:29.421611 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.421578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:29.532012 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.531978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:29.655522 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.655489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhf2x" event={"ID":"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c","Type":"ContainerStarted","Data":"2b345a03cddb54fecb3ebe30e30c7292eef4091cdc23fc436311f245b1d220ff"}
Jun 11 21:19:29.655697 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.655542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhf2x" event={"ID":"1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c","Type":"ContainerStarted","Data":"1cd78d2c3467e33073f19c35954d84da7f5a8ed518d22942c7321d2fa526822d"}
Jun 11 21:19:29.657116 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.657096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9gtd" event={"ID":"1e83b37c-9afe-414f-a350-ef929353f64b","Type":"ContainerStarted","Data":"e8c055ff73053f9297cc1538de378e95ec76be7bd6ae8abcc1a5eceb7aa8739d"}
Jun 11 21:19:29.672486 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.671816    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mhf2x" podStartSLOduration=252.162784555 podStartE2EDuration="4m14.671795403s" totalImagesPullingTime="2.509010848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:29.671488248 +0000 UTC m=+254.252423353" watchObservedRunningTime="2026-06-11 21:19:29.671795403 +0000 UTC m=+254.252730506"
Jun 11 21:19:29.720126 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:29.720094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:30.250833 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:30.250809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:30.549565 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:30.549485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:30.616702 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:30.616660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:30.663342 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:30.663300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9gtd" event={"ID":"1e83b37c-9afe-414f-a350-ef929353f64b","Type":"ContainerStarted","Data":"374310d42674b96369bef584a82cc224727ff50fbc87a36de8cbcaa76dce1194"}
Jun 11 21:19:31.558603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.558565    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-fd89d"]
Jun 11 21:19:31.567022 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.566995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:31.569432 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.569407    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 11 21:19:31.569587 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.569521    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 11 21:19:31.569587 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.569579    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zt6rh\""
Jun 11 21:19:31.573690 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.573666    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-fd89d"]
Jun 11 21:19:31.600237 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.600202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqk4\" (UniqueName: \"kubernetes.io/projected/2e69a670-32cc-4a0e-9a41-ffd98e66c37e-kube-api-access-9rqk4\") pod \"downloads-694c955b9-fd89d\" (UID: \"2e69a670-32cc-4a0e-9a41-ffd98e66c37e\") " pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:31.701008 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.700973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqk4\" (UniqueName: \"kubernetes.io/projected/2e69a670-32cc-4a0e-9a41-ffd98e66c37e-kube-api-access-9rqk4\") pod \"downloads-694c955b9-fd89d\" (UID: \"2e69a670-32cc-4a0e-9a41-ffd98e66c37e\") " pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:31.733495 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.733459    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqk4\" (UniqueName: \"kubernetes.io/projected/2e69a670-32cc-4a0e-9a41-ffd98e66c37e-kube-api-access-9rqk4\") pod \"downloads-694c955b9-fd89d\" (UID: \"2e69a670-32cc-4a0e-9a41-ffd98e66c37e\") " pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:31.735662 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.735636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:31.824619 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.824590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:31.881747 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.881702    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:31.906056 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:31.906025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:32.028740 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:32.028708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-fd89d"]
Jun 11 21:19:32.031676 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:32.031639    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e69a670_32cc_4a0e_9a41_ffd98e66c37e.slice/crio-c3837368e60a8fdc367ea9b3ae004b8f259fe3a0ccc6b0cd2284f289bc9f217c WatchSource:0}: Error finding container c3837368e60a8fdc367ea9b3ae004b8f259fe3a0ccc6b0cd2284f289bc9f217c: Status 404 returned error can't find the container with id c3837368e60a8fdc367ea9b3ae004b8f259fe3a0ccc6b0cd2284f289bc9f217c
Jun 11 21:19:32.679035 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:32.678887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9gtd" event={"ID":"1e83b37c-9afe-414f-a350-ef929353f64b","Type":"ContainerStarted","Data":"1d42c840545a82e0a40f0c040025692c8e62f2c60d28be561f55d72f2f33fdbf"}
Jun 11 21:19:32.680573 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:32.680540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-fd89d" event={"ID":"2e69a670-32cc-4a0e-9a41-ffd98e66c37e","Type":"ContainerStarted","Data":"c3837368e60a8fdc367ea9b3ae004b8f259fe3a0ccc6b0cd2284f289bc9f217c"}
Jun 11 21:19:32.698009 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:32.697942    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9gtd" podStartSLOduration=17.406793865 podStartE2EDuration="23.697923286s" totalImagesPullingTime="6.291129421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:19:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:32.697747284 +0000 UTC m=+257.278682407" watchObservedRunningTime="2026-06-11 21:19:32.697923286 +0000 UTC m=+257.278858390"
Jun 11 21:19:35.758656 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:35.758601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:35.811356 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:35.811325    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:36.444611 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:36.444574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:36.447954 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:36.447925    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac169553-1997-44de-a37a-f5240da6e15b-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-gnppz\" (UID: \"ac169553-1997-44de-a37a-f5240da6e15b\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:36.688005 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:36.687977    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7zxb4\""
Jun 11 21:19:36.695876 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:36.695798    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz"
Jun 11 21:19:36.893304 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:36.888534    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-gnppz"]
Jun 11 21:19:37.701157 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.701113    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz" event={"ID":"ac169553-1997-44de-a37a-f5240da6e15b","Type":"ContainerStarted","Data":"58c0372178788c6dada23da5dd1bad8033690004b15644e8b7cfd0e762092a7f"}
Jun 11 21:19:37.952824 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.952237    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:19:37.952824 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.952597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:37.955996 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.955973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:37.958531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.958505    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z2vmg\""
Jun 11 21:19:37.958661 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.958576    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 11 21:19:37.959689 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.959664    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 11 21:19:37.959817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.959709    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 11 21:19:37.959817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.959793    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 11 21:19:37.959817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.959809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 11 21:19:37.964892 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.964863    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:19:37.965078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:37.965014    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 11 21:19:38.059641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.059641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.059878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.059878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.059878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.060037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.060037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.059971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2fjt\" (UniqueName: \"kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161413 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161413 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161457    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2fjt\" (UniqueName: \"kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.161988 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.161961    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.162089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.162029    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.162398 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.162354    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.162652 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.162630    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.164304 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.164242    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.165110 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.165092    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.170022 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.169974    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2fjt\" (UniqueName: \"kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt\") pod \"console-65894494dd-hnhpc\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") " pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.270414 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.270378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:38.431907 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.431860    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:19:38.435582 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:38.435550    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fbfe4b_c556_43b5_82d9_d59574f2de7b.slice/crio-772f3f8fd06261cf59e536705c9b67bee995df4f5847e789e1af9fe8163c6031 WatchSource:0}: Error finding container 772f3f8fd06261cf59e536705c9b67bee995df4f5847e789e1af9fe8163c6031: Status 404 returned error can't find the container with id 772f3f8fd06261cf59e536705c9b67bee995df4f5847e789e1af9fe8163c6031
Jun 11 21:19:38.706626 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.706587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65894494dd-hnhpc" event={"ID":"a5fbfe4b-c556-43b5-82d9-d59574f2de7b","Type":"ContainerStarted","Data":"772f3f8fd06261cf59e536705c9b67bee995df4f5847e789e1af9fe8163c6031"}
Jun 11 21:19:38.708195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.708167    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz" event={"ID":"ac169553-1997-44de-a37a-f5240da6e15b","Type":"ContainerStarted","Data":"c14ca390ec173b0b15b3b46526f1742bf8683fe2518bb82a01260d4f301e3173"}
Jun 11 21:19:38.724718 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.724656    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-gnppz" podStartSLOduration=33.349638932 podStartE2EDuration="34.724637843s" totalImagesPullingTime="1.374998911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:38.723708569 +0000 UTC m=+263.304643684" watchObservedRunningTime="2026-06-11 21:19:38.724637843 +0000 UTC m=+263.305572944"
Jun 11 21:19:38.825399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.825363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:38.927125 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:38.927087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:39.153245 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:39.153205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:39.253953 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:39.253921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:39.360195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:39.360121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:39.692915 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:39.692878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:41.752147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:41.752094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:41.823952 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:41.823916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:42.377501 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:42.377464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:42.442691 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:42.442654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:42.850918 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:42.850882    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:45.074884 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:45.074852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:45.546930 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:45.546830    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:45.648179 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:45.648141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:47.547735 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.547699    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:47.741217 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.740822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:47.754674 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.754640    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"]
Jun 11 21:19:47.759111 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.759074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.764190 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.764164    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 11 21:19:47.764378 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.764348    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 11 21:19:47.765446 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.765424    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 11 21:19:47.767089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.765460    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 11 21:19:47.767089 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.767027    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 11 21:19:47.767545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.765728    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r5tkp\""
Jun 11 21:19:47.768955 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.768927    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"]
Jun 11 21:19:47.782449 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.782422    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"]
Jun 11 21:19:47.786039 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.786003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.791141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.790941    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 11 21:19:47.793126 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.793107    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 11 21:19:47.802216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.802150    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 11 21:19:47.807168 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.807117    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mwsrw\""
Jun 11 21:19:47.813888 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.813863    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"]
Jun 11 21:19:47.815738 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.815716    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9qjqs"]
Jun 11 21:19:47.820017 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.819995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.822648 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.822628    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 11 21:19:47.822998 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.822980    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 11 21:19:47.823203 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.823174    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 11 21:19:47.823557 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.823537    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mzcr4\""
Jun 11 21:19:47.832579 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.832493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:47.850392 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.850627 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b6add45-f669-49bf-a3bc-114ac7c66305-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.850831 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.850933 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.850933 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.851041 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gln\" (UniqueName: \"kubernetes.io/projected/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-api-access-q6gln\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.851041 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.850971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vnz\" (UniqueName: \"kubernetes.io/projected/2709c530-9560-4c31-b66a-368e870b7e6b-kube-api-access-69vnz\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.851297 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.851043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.851297 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.851114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2709c530-9560-4c31-b66a-368e870b7e6b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.851297 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.851157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.935116 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.935051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:47.952352 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952352 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b6add45-f669-49bf-a3bc-114ac7c66305-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.952352 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-wtmp\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-root\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gln\" (UniqueName: \"kubernetes.io/projected/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-api-access-q6gln\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vnz\" (UniqueName: \"kubernetes.io/projected/2709c530-9560-4c31-b66a-368e870b7e6b-kube-api-access-69vnz\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.952644 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2709c530-9560-4c31-b66a-368e870b7e6b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s6lv\" (UniqueName: \"kubernetes.io/projected/e9659a11-3a70-48c3-8770-0c639b434b34-kube-api-access-5s6lv\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-textfile\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-sys\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-metrics-client-ca\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:47.952981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.952857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.954664 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.953702    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.954664 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:47.954281    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 11 21:19:47.954664 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.954323    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2709c530-9560-4c31-b66a-368e870b7e6b-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.954664 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:47.954355    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls podName:2709c530-9560-4c31-b66a-368e870b7e6b nodeName:}" failed. No retries permitted until 2026-06-11 21:19:48.454336521 +0000 UTC m=+273.035271614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-kkfs7" (UID: "2709c530-9560-4c31-b66a-368e870b7e6b") : secret "openshift-state-metrics-tls" not found
Jun 11 21:19:47.955239 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.955216    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6add45-f669-49bf-a3bc-114ac7c66305-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.955599 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.955577    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9b6add45-f669-49bf-a3bc-114ac7c66305-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.958470 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.958406    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.958841 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.958814    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:47.960680 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.960633    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.976279 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.976111    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gln\" (UniqueName: \"kubernetes.io/projected/9b6add45-f669-49bf-a3bc-114ac7c66305-kube-api-access-q6gln\") pod \"kube-state-metrics-678bc549d7-7zczq\" (UID: \"9b6add45-f669-49bf-a3bc-114ac7c66305\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:47.980270 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:47.976825    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vnz\" (UniqueName: \"kubernetes.io/projected/2709c530-9560-4c31-b66a-368e870b7e6b-kube-api-access-69vnz\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:48.053687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s6lv\" (UniqueName: \"kubernetes.io/projected/e9659a11-3a70-48c3-8770-0c639b434b34-kube-api-access-5s6lv\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-textfile\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-sys\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-metrics-client-ca\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.053900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-wtmp\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054188 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.053944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-root\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054188 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054131    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-root\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054337 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:48.054218    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 11 21:19:48.054337 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054305    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-accelerators-collector-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054433 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:48.054383    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls podName:e9659a11-3a70-48c3-8770-0c639b434b34 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:48.55436338 +0000 UTC m=+273.135298463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls") pod "node-exporter-9qjqs" (UID: "e9659a11-3a70-48c3-8770-0c639b434b34") : secret "node-exporter-tls" not found
Jun 11 21:19:48.054494 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054453    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-wtmp\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054541 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054508    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9659a11-3a70-48c3-8770-0c639b434b34-sys\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054947 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054602    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9659a11-3a70-48c3-8770-0c639b434b34-metrics-client-ca\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.054947 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.054785    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-textfile\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.056902 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.056879    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.072318 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.072289    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s6lv\" (UniqueName: \"kubernetes.io/projected/e9659a11-3a70-48c3-8770-0c639b434b34-kube-api-access-5s6lv\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.115422 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.115383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"
Jun 11 21:19:48.149749 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.149706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.240275 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.240188    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.341390 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.341357    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.441574 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.441544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.457750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.457712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:48.460655 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.460624    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2709c530-9560-4c31-b66a-368e870b7e6b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-kkfs7\" (UID: \"2709c530-9560-4c31-b66a-368e870b7e6b\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:48.558447 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.558402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.561270 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.561224    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9659a11-3a70-48c3-8770-0c639b434b34-node-exporter-tls\") pod \"node-exporter-9qjqs\" (UID: \"e9659a11-3a70-48c3-8770-0c639b434b34\") " pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.678639 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.678546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"
Jun 11 21:19:48.693068 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.693013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.734319 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.734216    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9qjqs"
Jun 11 21:19:48.789276 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.789237    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.856925 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:48.856884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:48.940612 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:48.940320    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9659a11_3a70_48c3_8770_0c639b434b34.slice/crio-740d11f4bb3ecf3b4e5c4a9f85f12d1704e748877a9e9e7e94462998e1de8794 WatchSource:0}: Error finding container 740d11f4bb3ecf3b4e5c4a9f85f12d1704e748877a9e9e7e94462998e1de8794: Status 404 returned error can't find the container with id 740d11f4bb3ecf3b4e5c4a9f85f12d1704e748877a9e9e7e94462998e1de8794
Jun 11 21:19:49.007164 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.007088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:49.098605 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.098436    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7"]
Jun 11 21:19:49.107817 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:49.107765    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2709c530_9560_4c31_b66a_368e870b7e6b.slice/crio-1ab8d0837fbbfc588ab504f9ce4592dfb452f511cdd73034eed043375c0de8de WatchSource:0}: Error finding container 1ab8d0837fbbfc588ab504f9ce4592dfb452f511cdd73034eed043375c0de8de: Status 404 returned error can't find the container with id 1ab8d0837fbbfc588ab504f9ce4592dfb452f511cdd73034eed043375c0de8de
Jun 11 21:19:49.119878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.119803    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-7zczq"]
Jun 11 21:19:49.123792 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:49.123755    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6add45_f669_49bf_a3bc_114ac7c66305.slice/crio-8aad38b4775cbc60868bb495168edfba8f7123c825c9105c35a4450e55e17df9 WatchSource:0}: Error finding container 8aad38b4775cbc60868bb495168edfba8f7123c825c9105c35a4450e55e17df9: Status 404 returned error can't find the container with id 8aad38b4775cbc60868bb495168edfba8f7123c825c9105c35a4450e55e17df9
Jun 11 21:19:49.755160 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.755085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qjqs" event={"ID":"e9659a11-3a70-48c3-8770-0c639b434b34","Type":"ContainerStarted","Data":"740d11f4bb3ecf3b4e5c4a9f85f12d1704e748877a9e9e7e94462998e1de8794"}
Jun 11 21:19:49.758293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.757975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-fd89d" event={"ID":"2e69a670-32cc-4a0e-9a41-ffd98e66c37e","Type":"ContainerStarted","Data":"bad895e01d30ae3f8c501ffcc425a11e70b31756061fca06e5a43b5f21b4023c"}
Jun 11 21:19:49.758774 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.758742    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:49.761882 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.761847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq" event={"ID":"9b6add45-f669-49bf-a3bc-114ac7c66305","Type":"ContainerStarted","Data":"8aad38b4775cbc60868bb495168edfba8f7123c825c9105c35a4450e55e17df9"}
Jun 11 21:19:49.764122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.764092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7" event={"ID":"2709c530-9560-4c31-b66a-368e870b7e6b","Type":"ContainerStarted","Data":"3fbc5e7831509acbb247eb766da5303d9d0f7742da4e92c717b999fb1de6292f"}
Jun 11 21:19:49.764238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.764153    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7" event={"ID":"2709c530-9560-4c31-b66a-368e870b7e6b","Type":"ContainerStarted","Data":"2e35b006e802a08844906186929b1d02b69caa4f501c21861e62fdf7e2aa0ad7"}
Jun 11 21:19:49.764238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.764185    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7" event={"ID":"2709c530-9560-4c31-b66a-368e870b7e6b","Type":"ContainerStarted","Data":"1ab8d0837fbbfc588ab504f9ce4592dfb452f511cdd73034eed043375c0de8de"}
Jun 11 21:19:49.767038 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.766458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65894494dd-hnhpc" event={"ID":"a5fbfe4b-c556-43b5-82d9-d59574f2de7b","Type":"ContainerStarted","Data":"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"}
Jun 11 21:19:49.770556 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.770529    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-fd89d"
Jun 11 21:19:49.816287 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.816194    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-fd89d" podStartSLOduration=1.841867552 podStartE2EDuration="18.816171415s" totalImagesPullingTime="16.974303863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:49.815127189 +0000 UTC m=+274.396062347" watchObservedRunningTime="2026-06-11 21:19:49.816171415 +0000 UTC m=+274.397106517"
Jun 11 21:19:49.889559 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:49.888869    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65894494dd-hnhpc" podStartSLOduration=2.387514007 podStartE2EDuration="12.888844984s" totalImagesPullingTime="10.501330977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:49.887510376 +0000 UTC m=+274.468445477" watchObservedRunningTime="2026-06-11 21:19:49.888844984 +0000 UTC m=+274.469780086"
Jun 11 21:19:50.773555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.773513    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9659a11-3a70-48c3-8770-0c639b434b34" containerID="2600c04ac4c9ff434fdb2dbb513918dd5da711687f779dc722e2f2357ade668d" exitCode=0
Jun 11 21:19:50.774060 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.773605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qjqs" event={"ID":"e9659a11-3a70-48c3-8770-0c639b434b34","Type":"ContainerDied","Data":"2600c04ac4c9ff434fdb2dbb513918dd5da711687f779dc722e2f2357ade668d"}
Jun 11 21:19:50.865423 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.858763    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9cf98b76f-gzmql"]
Jun 11 21:19:50.887278 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.886334    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9cf98b76f-gzmql"]
Jun 11 21:19:50.887278 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.886787    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.891660    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.891880    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.892008    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hvjsz\""
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.892186    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.896690    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6930ee7hcvcdq\""
Jun 11 21:19:50.897357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.896694    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 11 21:19:50.906524 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.902931    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 11 21:19:50.909750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.909620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:50.971890 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.971853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:50.984726 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.984684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-grpc-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.984982 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.984953    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985020    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90bc2019-ace1-475f-8898-2b6f1366e26b-metrics-client-ca\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985162 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985215 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:50.985293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:50.985284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvt7v\" (UniqueName: \"kubernetes.io/projected/90bc2019-ace1-475f-8898-2b6f1366e26b-kube-api-access-dvt7v\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.086724 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.086683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.087241 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.087215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.088077 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.088053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.088611 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.088591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvt7v\" (UniqueName: \"kubernetes.io/projected/90bc2019-ace1-475f-8898-2b6f1366e26b-kube-api-access-dvt7v\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.089152 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.089133    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-grpc-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.089667 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.089650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.090208 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.090190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90bc2019-ace1-475f-8898-2b6f1366e26b-metrics-client-ca\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.091069 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.091051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.091566 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.091004    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90bc2019-ace1-475f-8898-2b6f1366e26b-metrics-client-ca\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.093449 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.093394    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-grpc-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.099598 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.099536    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvt7v\" (UniqueName: \"kubernetes.io/projected/90bc2019-ace1-475f-8898-2b6f1366e26b-kube-api-access-dvt7v\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.099598 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.099579    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.101493 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.101450    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-tls\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.104464 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.104407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.105630 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.105604    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.106606 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.106388    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90bc2019-ace1-475f-8898-2b6f1366e26b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9cf98b76f-gzmql\" (UID: \"90bc2019-ace1-475f-8898-2b6f1366e26b\") " pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.210162 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.210123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:51.212320 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.212290    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:51.675126 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.674134    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9cf98b76f-gzmql"]
Jun 11 21:19:51.677962 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:51.677887    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bc2019_ace1_475f_8898_2b6f1366e26b.slice/crio-a175b49674d617bd3d1c8a74124a16e7e395beb253be856223aef86349a6f98e WatchSource:0}: Error finding container a175b49674d617bd3d1c8a74124a16e7e395beb253be856223aef86349a6f98e: Status 404 returned error can't find the container with id a175b49674d617bd3d1c8a74124a16e7e395beb253be856223aef86349a6f98e
Jun 11 21:19:51.791052 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.790579    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"a175b49674d617bd3d1c8a74124a16e7e395beb253be856223aef86349a6f98e"}
Jun 11 21:19:51.794583 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.794451    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qjqs" event={"ID":"e9659a11-3a70-48c3-8770-0c639b434b34","Type":"ContainerStarted","Data":"8f5f9f9b14f5b4e37ee8d47264dec4569c46b7318db4e2a6bcc79f13ad8ac947"}
Jun 11 21:19:51.794583 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.794507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9qjqs" event={"ID":"e9659a11-3a70-48c3-8770-0c639b434b34","Type":"ContainerStarted","Data":"7df4d2f005aff4435375244152e71734fb45d274b87a1072cad2a9b5cbce2ac8"}
Jun 11 21:19:51.797525 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.797401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq" event={"ID":"9b6add45-f669-49bf-a3bc-114ac7c66305","Type":"ContainerStarted","Data":"8231c73874e20179ce355ac8ef396920c9022e98dbea813a9795bf97b5120554"}
Jun 11 21:19:51.797525 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.797461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq" event={"ID":"9b6add45-f669-49bf-a3bc-114ac7c66305","Type":"ContainerStarted","Data":"6c268dd20452a80980f0e8e49fc7d6dedb2c20573b2ab4dfd67ff41a0b908771"}
Jun 11 21:19:51.804060 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.801770    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7" event={"ID":"2709c530-9560-4c31-b66a-368e870b7e6b","Type":"ContainerStarted","Data":"4f52b0a6be818a4aeeaf9f8759524c1d851827ab55f4c968e0120083ad951152"}
Jun 11 21:19:51.825374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.825289    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:51.830720 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.830661    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9qjqs" podStartSLOduration=3.57784306 podStartE2EDuration="4.830642805s" totalImagesPullingTime="1.160292187s" totalInitContainerRuntime="92.507558ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:51.83058106 +0000 UTC m=+276.411516163" watchObservedRunningTime="2026-06-11 21:19:51.830642805 +0000 UTC m=+276.411577903"
Jun 11 21:19:51.853907 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:51.852178    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-kkfs7" podStartSLOduration=2.620711906 podStartE2EDuration="4.852157467s" totalImagesPullingTime="2.231445561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:51.851578041 +0000 UTC m=+276.432513167" watchObservedRunningTime="2026-06-11 21:19:51.852157467 +0000 UTC m=+276.433092568"
Jun 11 21:19:52.166357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.166325    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:52.266132 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.266097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:52.570615 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.570588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:52.662996 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.662963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:52.813133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.813098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq" event={"ID":"9b6add45-f669-49bf-a3bc-114ac7c66305","Type":"ContainerStarted","Data":"66a725f789a0d5576202eea6c27c4b70d59c4e0ac79e57947a659b7e398854ac"}
Jun 11 21:19:52.832953 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.832844    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-7zczq" podStartSLOduration=3.475329909 podStartE2EDuration="5.832821465s" totalImagesPullingTime="2.357491556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:52.831536228 +0000 UTC m=+277.412471331" watchObservedRunningTime="2026-06-11 21:19:52.832821465 +0000 UTC m=+277.413756565"
Jun 11 21:19:52.987971 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:52.987932    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"]
Jun 11 21:19:53.047565 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.047531    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"]
Jun 11 21:19:53.047747 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.047677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.050928 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.050901    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bw2z9\""
Jun 11 21:19:53.051409 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.051390    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 11 21:19:53.052019 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.051847    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 11 21:19:53.052019 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.051990    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 11 21:19:53.052695 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.052348    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 11 21:19:53.052695 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.052561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 11 21:19:53.059785 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.057936    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 11 21:19:53.216703 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.216703 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-federate-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.216943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.216943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.216943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-metrics-client-ca\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.216943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-telemeter-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.217141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.216951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjth2\" (UniqueName: \"kubernetes.io/projected/5998a009-c582-474e-8f00-851268321d11-kube-api-access-mjth2\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.217141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.217017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-serving-certs-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317691 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-telemeter-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317691 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjth2\" (UniqueName: \"kubernetes.io/projected/5998a009-c582-474e-8f00-851268321d11-kube-api-access-mjth2\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317945 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-serving-certs-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317945 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317862    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317945 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-federate-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.317945 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.318143 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.317967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.318143 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.318003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-metrics-client-ca\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.318850 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.318820    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-serving-certs-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.319436 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.319006    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-metrics-client-ca\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.320109 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.320040    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5998a009-c582-474e-8f00-851268321d11-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.321916 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.321888    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-telemeter-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.322047 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.321955    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-federate-client-tls\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.322417 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.322390    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.322810 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.322788    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5998a009-c582-474e-8f00-851268321d11-secret-telemeter-client\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.327228 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.327204    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjth2\" (UniqueName: \"kubernetes.io/projected/5998a009-c582-474e-8f00-851268321d11-kube-api-access-mjth2\") pod \"telemeter-client-8f5858cf8-kdlzw\" (UID: \"5998a009-c582-474e-8f00-851268321d11\") " pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.364179 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.364137    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"
Jun 11 21:19:53.442893 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.442839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:53.574431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:53.574389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8f5858cf8-kdlzw"]
Jun 11 21:19:54.162524 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:54.162458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:54.264427 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:19:54.264379    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5998a009_c582_474e_8f00_851268321d11.slice/crio-514a8f9a1e4f314b3d78d58bccb55f8db0f58d5bbf32e52ce9c4ae37c38f05a1 WatchSource:0}: Error finding container 514a8f9a1e4f314b3d78d58bccb55f8db0f58d5bbf32e52ce9c4ae37c38f05a1: Status 404 returned error can't find the container with id 514a8f9a1e4f314b3d78d58bccb55f8db0f58d5bbf32e52ce9c4ae37c38f05a1
Jun 11 21:19:54.824482 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:54.824436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw" event={"ID":"5998a009-c582-474e-8f00-851268321d11","Type":"ContainerStarted","Data":"514a8f9a1e4f314b3d78d58bccb55f8db0f58d5bbf32e52ce9c4ae37c38f05a1"}
Jun 11 21:19:55.834563 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:55.834520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"26edb2d84bf238585f4be6e21d009ea962b37d928806e1ccb9701af070758e1d"}
Jun 11 21:19:55.835165 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:55.835132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"21742e90c6196f019417c031a47882e33ac4179df6b09020725fe42f6a47a829"}
Jun 11 21:19:55.835165 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:55.835177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"205c42049d34ae69c25a7c08f25df3354ecae61a15f32d0b43db301457eab3bc"}
Jun 11 21:19:56.753274 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:56.753225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:57.036285 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.036160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:57.136319 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.136281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:19:57.371242 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:57.371199    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"
Jun 11 21:19:57.371422 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:19:57.371199    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nt4g2" podUID="cb1995ac-e412-4f9c-8a33-4fd624133161"
Jun 11 21:19:57.849608 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.848278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"3648839118dd20a01c42666776ae119d9453e03b9a5edb112a90352153f2c115"}
Jun 11 21:19:57.849608 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.848370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"5ad351f24b9352ea6f9a87c03c9bb13b9da36bfef959486c829454103ef50814"}
Jun 11 21:19:57.849608 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.848412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" event={"ID":"90bc2019-ace1-475f-8898-2b6f1366e26b","Type":"ContainerStarted","Data":"a4294dea605b8eb377d10e168205b8b5f0394f82b32c8d7793d2fe6000e1088f"}
Jun 11 21:19:57.849608 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.849523    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:57.852224 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.852177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:19:57.852529 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.852512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:19:57.852634 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.852150    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw" event={"ID":"5998a009-c582-474e-8f00-851268321d11","Type":"ContainerStarted","Data":"a7749b2579723395958ad1dc08ea9df9cbc993893e3126fa9b3ea78a59835481"}
Jun 11 21:19:57.874742 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:57.874466    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql" podStartSLOduration=2.929889399 podStartE2EDuration="7.874444414s" totalImagesPullingTime="4.944555015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:57.871570196 +0000 UTC m=+282.452505312" watchObservedRunningTime="2026-06-11 21:19:57.874444414 +0000 UTC m=+282.455379516"
Jun 11 21:19:58.271669 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:58.271552    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:58.271669 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:58.271618    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:19:58.273204 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:58.273169    2570 patch_prober.go:28] interesting pod/console-65894494dd-hnhpc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
Jun 11 21:19:58.273388 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:58.273231    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65894494dd-hnhpc" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
Jun 11 21:19:59.863328 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:59.863287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw" event={"ID":"5998a009-c582-474e-8f00-851268321d11","Type":"ContainerStarted","Data":"7c9b40a5715bc2ee0d16e7d4dcfe7f220e3d88985f9cb25b6c11fc354280aab3"}
Jun 11 21:19:59.863864 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:59.863350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw" event={"ID":"5998a009-c582-474e-8f00-851268321d11","Type":"ContainerStarted","Data":"be026546ebc3b1b5f4bc8dcfb8a14cb142faed77beff6118b0430ad0dcfc3abe"}
Jun 11 21:19:59.868881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:59.868858    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9cf98b76f-gzmql"
Jun 11 21:19:59.888013 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:59.887959    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8f5858cf8-kdlzw" podStartSLOduration=3.521090119 podStartE2EDuration="7.887941226s" totalImagesPullingTime="4.366851107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:59.886178635 +0000 UTC m=+284.467113754" watchObservedRunningTime="2026-06-11 21:19:59.887941226 +0000 UTC m=+284.468876326"
Jun 11 21:19:59.979692 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:19:59.979657    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:20:00.797724 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.797680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:20:00.797941 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.797753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:00.800375 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.800342    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb1995ac-e412-4f9c-8a33-4fd624133161-metrics-tls\") pod \"dns-default-nt4g2\" (UID: \"cb1995ac-e412-4f9c-8a33-4fd624133161\") " pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:20:00.800492 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.800417    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"image-registry-5bb868946-ttr2t\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") " pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:00.856167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.856135    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q62t8\""
Jun 11 21:20:00.856167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.856145    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td2lf\""
Jun 11 21:20:00.863133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.863094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:00.863133 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:00.863119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:20:01.044952 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.044898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:20:01.047352 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:20:01.047319    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2496926_b4a7_40ad_9dd5_d32e2a9e7b53.slice/crio-c3bb76e197f52bcf2c2e0be47a6a179db64afa98f4a84cf6de7d044e1081a4b4 WatchSource:0}: Error finding container c3bb76e197f52bcf2c2e0be47a6a179db64afa98f4a84cf6de7d044e1081a4b4: Status 404 returned error can't find the container with id c3bb76e197f52bcf2c2e0be47a6a179db64afa98f4a84cf6de7d044e1081a4b4
Jun 11 21:20:01.061407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.061378    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nt4g2"]
Jun 11 21:20:01.064397 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:20:01.064363    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1995ac_e412_4f9c_8a33_4fd624133161.slice/crio-3b5cdcb0e5b041cb5cc3e9e719386bb7fd4791c4553363aa05870f3d23afda53 WatchSource:0}: Error finding container 3b5cdcb0e5b041cb5cc3e9e719386bb7fd4791c4553363aa05870f3d23afda53: Status 404 returned error can't find the container with id 3b5cdcb0e5b041cb5cc3e9e719386bb7fd4791c4553363aa05870f3d23afda53
Jun 11 21:20:01.873604 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.873554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" event={"ID":"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53","Type":"ContainerStarted","Data":"b80eb3e92207b14a2c8438f84168818f487556ad8e7a8c92445a052f26ba8d51"}
Jun 11 21:20:01.873797 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.873619    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:01.873797 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.873638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" event={"ID":"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53","Type":"ContainerStarted","Data":"c3bb76e197f52bcf2c2e0be47a6a179db64afa98f4a84cf6de7d044e1081a4b4"}
Jun 11 21:20:01.875296 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.875247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt4g2" event={"ID":"cb1995ac-e412-4f9c-8a33-4fd624133161","Type":"ContainerStarted","Data":"3b5cdcb0e5b041cb5cc3e9e719386bb7fd4791c4553363aa05870f3d23afda53"}
Jun 11 21:20:01.896923 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:01.896863    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" podStartSLOduration=285.896842204 podStartE2EDuration="4m45.896842204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:01.894296148 +0000 UTC m=+286.475231271" watchObservedRunningTime="2026-06-11 21:20:01.896842204 +0000 UTC m=+286.477777306"
Jun 11 21:20:04.889935 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:04.889893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt4g2" event={"ID":"cb1995ac-e412-4f9c-8a33-4fd624133161","Type":"ContainerStarted","Data":"5b9dfff9e127bb0e003f1a18310826b8b16663a14881d1bfe3b97d928fd79de1"}
Jun 11 21:20:04.890396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:04.889962    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:20:04.890396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:04.889981    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nt4g2" event={"ID":"cb1995ac-e412-4f9c-8a33-4fd624133161","Type":"ContainerStarted","Data":"3ef26dceb70e18b990b05683a5a8f701dd0050d1a2ecd24b9e9d0ed3eda7a856"}
Jun 11 21:20:04.911039 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:04.910989    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nt4g2" podStartSLOduration=251.794943854 podStartE2EDuration="4m14.910974221s" totalImagesPullingTime="3.116030367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:04.90918004 +0000 UTC m=+289.490115142" watchObservedRunningTime="2026-06-11 21:20:04.910974221 +0000 UTC m=+289.491909322"
Jun 11 21:20:06.270907 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:06.270871    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:06.343970 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:06.343936    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:12.064951 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:12.064908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:12.136847 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:12.136807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:14.897803 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:14.897774    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nt4g2"
Jun 11 21:20:15.686013 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.685960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:15.726015 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.725983    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:20:15.726587 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.726559    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:20:15.728984 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.728962    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:20:15.729740 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.729721    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:20:15.737125 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.737110    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jun 11 21:20:15.741416 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:15.741393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:19.955884 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:19.955852    2570 generic.go:356] "Generic (PLEG): container finished" podID="dc4206ba-184c-4bdf-947f-d4c6e553eb6e" containerID="38a2d38ae6e3dacafd7009b747bb7c909a952635dee54c36f8b957fff875e8ad" exitCode=0
Jun 11 21:20:19.956340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:19.955932    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj" event={"ID":"dc4206ba-184c-4bdf-947f-d4c6e553eb6e","Type":"ContainerDied","Data":"38a2d38ae6e3dacafd7009b747bb7c909a952635dee54c36f8b957fff875e8ad"}
Jun 11 21:20:19.956340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:19.956272    2570 scope.go:117] "RemoveContainer" containerID="38a2d38ae6e3dacafd7009b747bb7c909a952635dee54c36f8b957fff875e8ad"
Jun 11 21:20:20.625078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:20.625039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:20.868019 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:20.867979    2570 patch_prober.go:28] interesting pod/image-registry-5bb868946-ttr2t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 21:20:20.868189 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:20.868043    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 21:20:20.962562 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:20.962478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-r2ctj" event={"ID":"dc4206ba-184c-4bdf-947f-d4c6e553eb6e","Type":"ContainerStarted","Data":"269730c1b62a4f52d9dee7165402a068e48d672feb68861cf16566bf5165bd07"}
Jun 11 21:20:21.750887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:21.750834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:22.885917 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:22.885886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:23.086363 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:23.086331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:23.186956 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:23.186831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:23.976293 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:23.976239    2570 generic.go:356] "Generic (PLEG): container finished" podID="6739aa17-7177-4536-b99e-7fca6ddd80c3" containerID="394b21a56ff13b4a38eb76e136c8dc40b6bf6e977b3743bdec66167e9546893f" exitCode=0
Jun 11 21:20:23.976709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:23.976312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442" event={"ID":"6739aa17-7177-4536-b99e-7fca6ddd80c3","Type":"ContainerDied","Data":"394b21a56ff13b4a38eb76e136c8dc40b6bf6e977b3743bdec66167e9546893f"}
Jun 11 21:20:23.976805 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:23.976729    2570 scope.go:117] "RemoveContainer" containerID="394b21a56ff13b4a38eb76e136c8dc40b6bf6e977b3743bdec66167e9546893f"
Jun 11 21:20:24.029148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:24.029113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:24.125864 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:24.125825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:24.982881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:24.982847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-fp442" event={"ID":"6739aa17-7177-4536-b99e-7fca6ddd80c3","Type":"ContainerStarted","Data":"7a342faa9675f98295360c98b1f622b020ee63063ae2450207d3e1b7bb3bbe2c"}
Jun 11 21:20:25.001887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.001847    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65894494dd-hnhpc" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerName="console" containerID="cri-o://277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b" gracePeriod=15
Jun 11 21:20:25.030654 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.030627    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt4g2_cb1995ac-e412-4f9c-8a33-4fd624133161/dns/0.log"
Jun 11 21:20:25.230711 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.230681    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt4g2_cb1995ac-e412-4f9c-8a33-4fd624133161/kube-rbac-proxy/0.log"
Jun 11 21:20:25.284989 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.284960    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:20:25.337372 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337302    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337580 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337429    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337580 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337493    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2fjt\" (UniqueName: \"kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337580 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337542    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337739 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337599    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337739 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337636    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337739 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337728    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config\") pod \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\" (UID: \"a5fbfe4b-c556-43b5-82d9-d59574f2de7b\") "
Jun 11 21:20:25.337883 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337836    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:25.337949 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337917    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:25.337992 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.337979    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:25.338143 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.338127    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-oauth-serving-cert\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.338206 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.338146    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-service-ca\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.338206 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.338160    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-trusted-ca-bundle\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.338371 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.338214    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config" (OuterVolumeSpecName: "console-config") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:25.340110 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.340080    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:20:25.340229 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.340136    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:20:25.340229 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.340164    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt" (OuterVolumeSpecName: "kube-api-access-s2fjt") pod "a5fbfe4b-c556-43b5-82d9-d59574f2de7b" (UID: "a5fbfe4b-c556-43b5-82d9-d59574f2de7b"). InnerVolumeSpecName "kube-api-access-s2fjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:20:25.439452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.439415    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2fjt\" (UniqueName: \"kubernetes.io/projected/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-kube-api-access-s2fjt\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.439452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.439443    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-serving-cert\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.439452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.439454    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-oauth-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.439452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.439463    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5fbfe4b-c556-43b5-82d9-d59574f2de7b-console-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:25.696870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.696825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:25.750268 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.750233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:25.988163 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.988074    2570 generic.go:356] "Generic (PLEG): container finished" podID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerID="277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b" exitCode=0
Jun 11 21:20:25.988163 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.988132    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65894494dd-hnhpc"
Jun 11 21:20:25.988770 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.988172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65894494dd-hnhpc" event={"ID":"a5fbfe4b-c556-43b5-82d9-d59574f2de7b","Type":"ContainerDied","Data":"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"}
Jun 11 21:20:25.988770 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.988232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65894494dd-hnhpc" event={"ID":"a5fbfe4b-c556-43b5-82d9-d59574f2de7b","Type":"ContainerDied","Data":"772f3f8fd06261cf59e536705c9b67bee995df4f5847e789e1af9fe8163c6031"}
Jun 11 21:20:25.988770 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.988288    2570 scope.go:117] "RemoveContainer" containerID="277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"
Jun 11 21:20:25.998543 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.998523    2570 scope.go:117] "RemoveContainer" containerID="277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"
Jun 11 21:20:25.998824 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:20:25.998803    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b\": container with ID starting with 277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b not found: ID does not exist" containerID="277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"
Jun 11 21:20:25.998884 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:25.998830    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b"} err="failed to get container status \"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b\": rpc error: code = NotFound desc = could not find container \"277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b\": container with ID starting with 277ffff435c0916f6f295f0c4fb4627acece9b92626f595bb0ed409b55a52a8b not found: ID does not exist"
Jun 11 21:20:26.006350 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:26.006324    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:20:26.011630 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:26.011607    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65894494dd-hnhpc"]
Jun 11 21:20:26.229944 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:26.229914    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-489ln_e06bc113-442c-42db-9db3-3ea0fa6ce504/dns-node-resolver/0.log"
Jun 11 21:20:27.029525 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:27.029494    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c4t7g_c1ae5a40-0556-435a-a739-e04b9a6b3cf0/serve-healthcheck-canary/0.log"
Jun 11 21:20:27.040190 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:27.040158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:27.091968 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:27.091931    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:27.786149 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:27.785663    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" path="/var/lib/kubelet/pods/a5fbfe4b-c556-43b5-82d9-d59574f2de7b/volumes"
Jun 11 21:20:31.990126 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:31.990088    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:20:32.104384 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:32.104347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:32.204883 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:32.204853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:33.023771 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:33.023742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:33.078082 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:33.078046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:34.770859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:34.770822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:34.826484 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:34.826448    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:39.153135 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:39.153106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:39.252078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:39.251999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:42.059588 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:42.059540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:42.131148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:42.131120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:48.189121 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:48.189074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:57.011443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:57.011401    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerName="registry" containerID="cri-o://b80eb3e92207b14a2c8438f84168818f487556ad8e7a8c92445a052f26ba8d51" gracePeriod=30
Jun 11 21:20:57.052455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:57.052419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:57.136303 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:57.136271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:58.133904 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.133877    2570 generic.go:356] "Generic (PLEG): container finished" podID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerID="b80eb3e92207b14a2c8438f84168818f487556ad8e7a8c92445a052f26ba8d51" exitCode=0
Jun 11 21:20:58.134244 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.133961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" event={"ID":"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53","Type":"ContainerDied","Data":"b80eb3e92207b14a2c8438f84168818f487556ad8e7a8c92445a052f26ba8d51"}
Jun 11 21:20:58.276484 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.276452    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:58.424444 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424405    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424444 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424446    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424470    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424521    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424551    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424584    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.424710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424653    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xf9w\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w\") pod \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\" (UID: \"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53\") "
Jun 11 21:20:58.425034 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.424995    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:58.425092 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.425026    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:20:58.427409 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.427364    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:20:58.427409 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.427391    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:20:58.427703 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.427676    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:20:58.427820 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.427782    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:20:58.427820 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.427787    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w" (OuterVolumeSpecName: "kube-api-access-4xf9w") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "kube-api-access-4xf9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:20:58.433702 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.433675    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" (UID: "b2496926-b4a7-40ad-9dd5-d32e2a9e7b53"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:20:58.525958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525911    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-certificates\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.525958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525948    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.525958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525957    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xf9w\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-kube-api-access-4xf9w\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.525958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525966    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-ca-trust-extracted\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.526218 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525974    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-trusted-ca\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.526218 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525984    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-image-registry-private-configuration\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.526218 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.525993    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-installation-pull-secrets\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:58.526218 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:58.526001    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53-bound-sa-token\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:20:59.139267 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.139210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:59.139665 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.139439    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb868946-ttr2t"
Jun 11 21:20:59.139665 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.139455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb868946-ttr2t" event={"ID":"b2496926-b4a7-40ad-9dd5-d32e2a9e7b53","Type":"ContainerDied","Data":"c3bb76e197f52bcf2c2e0be47a6a179db64afa98f4a84cf6de7d044e1081a4b4"}
Jun 11 21:20:59.139665 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.139504    2570 scope.go:117] "RemoveContainer" containerID="b80eb3e92207b14a2c8438f84168818f487556ad8e7a8c92445a052f26ba8d51"
Jun 11 21:20:59.166370 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.166330    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:20:59.169681 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.169635    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bb868946-ttr2t"]
Jun 11 21:20:59.239844 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.239814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:59.301643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.301614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:20:59.779915 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:20:59.779882    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" path="/var/lib/kubelet/pods/b2496926-b4a7-40ad-9dd5-d32e2a9e7b53/volumes"
Jun 11 21:21:00.290279 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:00.290219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:00.349733 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:00.349700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:01.587707 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:01.587674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:04.033007 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:04.032924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:04.087742 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:04.087700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:09.380196 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380141    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:21:09.380741 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380657    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerName="registry"
Jun 11 21:21:09.380741 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380674    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerName="registry"
Jun 11 21:21:09.380741 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380690    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerName="console"
Jun 11 21:21:09.380741 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380700    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerName="console"
Jun 11 21:21:09.380919 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380784    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2496926-b4a7-40ad-9dd5-d32e2a9e7b53" containerName="registry"
Jun 11 21:21:09.380919 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.380797    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fbfe4b-c556-43b5-82d9-d59574f2de7b" containerName="console"
Jun 11 21:21:09.384172 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.384150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.388554 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388529    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 11 21:21:09.388723 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388550    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z2vmg\""
Jun 11 21:21:09.388723 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388539    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 11 21:21:09.388723 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388534    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 11 21:21:09.388723 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388688    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 11 21:21:09.388929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.388916    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 11 21:21:09.394480 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.394454    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 11 21:21:09.395602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.395577    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:21:09.441068 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.441036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:09.519434 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519620 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519620 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519620 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519620 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519753 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519658    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdpr8\" (UniqueName: \"kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.519753 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.519682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.573017 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.572976    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:09.620078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdpr8\" (UniqueName: \"kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620385 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.620989 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.620962    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.621148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.621120    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.621249 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.621120    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.621346 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.621244    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.623336 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.623230    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.623491 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.623395    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.633145 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.633030    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdpr8\" (UniqueName: \"kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8\") pod \"console-59f8b7ddc5-sc869\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") " pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.640071 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.640033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:09.695046 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.695009    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:09.838495 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:09.838429    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:21:09.841227 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:21:09.841201    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabdce04_3368_4fad_986d_99ca981f88bf.slice/crio-74f0effaf172371d3512efb5a7c664d2a00466c4a61eef8e901d78aa7ebf8fe2 WatchSource:0}: Error finding container 74f0effaf172371d3512efb5a7c664d2a00466c4a61eef8e901d78aa7ebf8fe2: Status 404 returned error can't find the container with id 74f0effaf172371d3512efb5a7c664d2a00466c4a61eef8e901d78aa7ebf8fe2
Jun 11 21:21:10.167041 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.166950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:10.186242 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.186208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8b7ddc5-sc869" event={"ID":"eabdce04-3368-4fad-986d-99ca981f88bf","Type":"ContainerStarted","Data":"94e5fd130185de92bb87a6d7538055c8bbb86a34cae9b64d842749789ff2fd68"}
Jun 11 21:21:10.186431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.186282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8b7ddc5-sc869" event={"ID":"eabdce04-3368-4fad-986d-99ca981f88bf","Type":"ContainerStarted","Data":"74f0effaf172371d3512efb5a7c664d2a00466c4a61eef8e901d78aa7ebf8fe2"}
Jun 11 21:21:10.204814 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.204747    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f8b7ddc5-sc869" podStartSLOduration=1.204725057 podStartE2EDuration="1.204725057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:10.204322682 +0000 UTC m=+354.785257794" watchObservedRunningTime="2026-06-11 21:21:10.204725057 +0000 UTC m=+354.785660159"
Jun 11 21:21:10.267610 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.267572    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:10.958310 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:10.958274    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:11.059427 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:11.059394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:19.695738 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:19.695695    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:19.695738 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:19.695750    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:19.700679 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:19.700654    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:20.236932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:20.236902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:21:20.394640 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:20.394607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:20.450444 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:20.450410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:20.514732 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:20.514648    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:27.054779 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:27.054746    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:27.190773 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:27.190730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:54.978497 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:54.978438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:21:55.036873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:21:55.036823    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:22:15.273591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:22:15.273537    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:22:15.330870 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:22:15.330839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:22:32.594923 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:22:32.594875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:23:19.428990 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:19.428949    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:23:19.527481 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:19.527445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:23:20.045025 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.044986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:23:20.059932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.059891    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:23:20.063147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.063123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:20.069328 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.069298    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 11 21:23:20.069489 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.069343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 11 21:23:20.069872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.069845    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-qq7gr\""
Jun 11 21:23:20.078480 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.078452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:23:20.207536 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.207494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522wl\" (UniqueName: \"kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl\") pod \"feast-operator-controller-manager-cdcf57cb5-m2ksv\" (UID: \"e13e7105-59a6-4d61-a858-aaed9874ed1a\") " pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:20.308814 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.308703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-522wl\" (UniqueName: \"kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl\") pod \"feast-operator-controller-manager-cdcf57cb5-m2ksv\" (UID: \"e13e7105-59a6-4d61-a858-aaed9874ed1a\") " pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:20.316725 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.316699    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522wl\" (UniqueName: \"kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl\") pod \"feast-operator-controller-manager-cdcf57cb5-m2ksv\" (UID: \"e13e7105-59a6-4d61-a858-aaed9874ed1a\") " pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:20.380541 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.380495    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:20.515067 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.515030    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:23:20.518236 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:23:20.518204    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13e7105_59a6_4d61_a858_aaed9874ed1a.slice/crio-d20389c46a739db12e0f9d93b90da61ee98fb59d186b4082c98ab401dc97d8cc WatchSource:0}: Error finding container d20389c46a739db12e0f9d93b90da61ee98fb59d186b4082c98ab401dc97d8cc: Status 404 returned error can't find the container with id d20389c46a739db12e0f9d93b90da61ee98fb59d186b4082c98ab401dc97d8cc
Jun 11 21:23:20.520141 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.520120    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 21:23:20.718101 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:20.718066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" event={"ID":"e13e7105-59a6-4d61-a858-aaed9874ed1a","Type":"ContainerStarted","Data":"d20389c46a739db12e0f9d93b90da61ee98fb59d186b4082c98ab401dc97d8cc"}
Jun 11 21:23:23.734577 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:23.734533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" event={"ID":"e13e7105-59a6-4d61-a858-aaed9874ed1a","Type":"ContainerStarted","Data":"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"}
Jun 11 21:23:23.734957 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:23.734616    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:23:23.749801 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:23.749749    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" podStartSLOduration=1.389620047 podStartE2EDuration="3.749730777s" totalImagesPullingTime="2.36011073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:23.749239424 +0000 UTC m=+488.330174529" watchObservedRunningTime="2026-06-11 21:23:23.749730777 +0000 UTC m=+488.330665899"
Jun 11 21:23:34.740965 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:23:34.740929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:24:02.339290 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.339241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:02.440456 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.440415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:02.657402 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.657294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:02.757495 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.757459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:02.765887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.765861    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:24:02.774085 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.774061    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.777243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.776892    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 11 21:24:02.777243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.776935    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 21:24:02.777243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777099    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 21:24:02.777243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777105    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 11 21:24:02.777243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777152    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jhwsv\""
Jun 11 21:24:02.777584 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777324    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 21:24:02.777584 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777513    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 11 21:24:02.777584 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.777542    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 11 21:24:02.785441 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.785419    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:24:02.828399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.828399 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.828641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxkd\" (UniqueName: \"kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.828641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.828641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.828641 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.828584    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.894672 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.894637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:02.929874 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.929793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.929874 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.929825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.929874 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.929849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxkd\" (UniqueName: \"kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.930202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.929988    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.930202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.930025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.930202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.930093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.930405 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:24:02.930200    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 21:24:02.930405 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:24:02.930237    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:24:02.930405 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:24:02.930288    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls podName:1d9ab181-7014-4572-8f00-c714de8ee20e nodeName:}" failed. No retries permitted until 2026-06-11 21:24:03.430247033 +0000 UTC m=+528.011182113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls") pod "feast-simple-feast-setup-6f588d8cb4-lcbns" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 21:24:02.930405 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.930307    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.930405 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:24:02.930329    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls podName:1d9ab181-7014-4572-8f00-c714de8ee20e nodeName:}" failed. No retries permitted until 2026-06-11 21:24:03.430309207 +0000 UTC m=+528.011244289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls") pod "feast-simple-feast-setup-6f588d8cb4-lcbns" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e") : secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:24:02.933059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.933034    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.933166 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.933095    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.941383 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.941361    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxkd\" (UniqueName: \"kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:02.996093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:02.996056    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:03.099404 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.099367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:03.197095 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.196999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:24:03.434841 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.434806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:03.435238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.434894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:03.437605 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.437569    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:03.437736 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.437603    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-lcbns\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:03.697148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.697095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:03.842733 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.842690    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:24:03.845867 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:24:03.845844    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d9ab181_7014_4572_8f00_c714de8ee20e.slice/crio-d57404d68a7f37571e8fc17aad3f149ed626b6895ee6315611bdb8416a05e65e WatchSource:0}: Error finding container d57404d68a7f37571e8fc17aad3f149ed626b6895ee6315611bdb8416a05e65e: Status 404 returned error can't find the container with id d57404d68a7f37571e8fc17aad3f149ed626b6895ee6315611bdb8416a05e65e
Jun 11 21:24:03.901195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:03.901163    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"d57404d68a7f37571e8fc17aad3f149ed626b6895ee6315611bdb8416a05e65e"}
Jun 11 21:24:39.063095 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:39.063049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"36354acb573bb6fa39d7c00cfe4638d6e5e3f3153baf848e56a6cc425eb4712d"}
Jun 11 21:24:44.086472 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:44.086439    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="36354acb573bb6fa39d7c00cfe4638d6e5e3f3153baf848e56a6cc425eb4712d" exitCode=0
Jun 11 21:24:44.086878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:44.086500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"36354acb573bb6fa39d7c00cfe4638d6e5e3f3153baf848e56a6cc425eb4712d"}
Jun 11 21:24:45.092489 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:45.092441    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"5132df7d5a99cf9e82b04836ff3c74f10852a33b150e8c06b1b45cc8e3b83dcb"}
Jun 11 21:24:50.116395 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:50.116363    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="5132df7d5a99cf9e82b04836ff3c74f10852a33b150e8c06b1b45cc8e3b83dcb" exitCode=0
Jun 11 21:24:50.116785 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:50.116428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"5132df7d5a99cf9e82b04836ff3c74f10852a33b150e8c06b1b45cc8e3b83dcb"}
Jun 11 21:24:50.125396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:50.125374    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 21:24:51.127904 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.127860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"6604fbd8e17932a1b2a352ac9a3ddc107d3bc367d415b6fc12616a9faffef93c"}
Jun 11 21:24:51.128430 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.127931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"752bad00ab5e8b3f382fee1833953af31da22b9925c24f55aed88f90d1634871"}
Jun 11 21:24:51.128430 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.127954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"88cd701079ef458a252c187a1fa8178b65358fd970a880196f636d8cf217eacb"}
Jun 11 21:24:51.128430 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.127973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerStarted","Data":"8dc6a4698857f98d4a503cff2aa4c4be3da756e26bbcd4d938f578b6a1c647ee"}
Jun 11 21:24:51.151096 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.151027    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podStartSLOduration=14.689616393 podStartE2EDuration="49.151005598s" totalImagesPullingTime="34.461389205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:51.150631551 +0000 UTC m=+575.731566679" watchObservedRunningTime="2026-06-11 21:24:51.151005598 +0000 UTC m=+575.731940700"
Jun 11 21:24:51.696742 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.696695    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:51.697935 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.697908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:51.698140 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698126    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:51.698296 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698248    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:51.698442 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698296    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Jun 11 21:24:51.698442 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698307    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jun 11 21:24:51.698704 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698674    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Jun 11 21:24:51.698805 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:51.698737    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jun 11 21:24:53.697768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:53.697717    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:53.697768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:53.697791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:53.698363 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:53.697809    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:53.698363 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:53.697827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:54.697478 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:54.697416    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
Jun 11 21:24:54.697673 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:54.697416    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Jun 11 21:24:54.697673 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:54.697431    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jun 11 21:24:54.697673 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:54.697621    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jun 11 21:24:57.698536 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.698503    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.698983 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.698633    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.698983 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.698921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.699676 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.699655    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.699772 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.699707    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.699915 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.699897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:57.703165 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:57.703147    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:58.168857 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:58.168821    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:24:58.512199 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:24:58.512115    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:13.656655 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:13.656621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:15.755243 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:15.755208    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:25:15.757542 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:15.757514    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:25:15.758593 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:15.758565    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:25:15.760837 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:15.760815    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:25:16.239123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:16.239085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:16.292933 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:16.292901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:16.384682 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:16.384644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:16.983556 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:16.983518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:27.147698 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:27.147660    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:25:27.256715 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:27.256683    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:28.269633 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:28.269591    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:25:52.168752 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.168685    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59f8b7ddc5-sc869" podUID="eabdce04-3368-4fad-986d-99ca981f88bf" containerName="console" containerID="cri-o://94e5fd130185de92bb87a6d7538055c8bbb86a34cae9b64d842749789ff2fd68" gracePeriod=15
Jun 11 21:25:52.389916 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.389885    2570 generic.go:356] "Generic (PLEG): container finished" podID="eabdce04-3368-4fad-986d-99ca981f88bf" containerID="94e5fd130185de92bb87a6d7538055c8bbb86a34cae9b64d842749789ff2fd68" exitCode=0
Jun 11 21:25:52.390088 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.389958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8b7ddc5-sc869" event={"ID":"eabdce04-3368-4fad-986d-99ca981f88bf","Type":"ContainerDied","Data":"94e5fd130185de92bb87a6d7538055c8bbb86a34cae9b64d842749789ff2fd68"}
Jun 11 21:25:52.421596 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.421533    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:25:52.524654 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524614    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.524838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.524838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524702    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.524838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.524838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524768    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.524838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524801    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdpr8\" (UniqueName: \"kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.525079 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.524842    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config\") pod \"eabdce04-3368-4fad-986d-99ca981f88bf\" (UID: \"eabdce04-3368-4fad-986d-99ca981f88bf\") "
Jun 11 21:25:52.525134 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.525073    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:25:52.525239 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.525209    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:25:52.525332 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.525282    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:25:52.525435 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.525354    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config" (OuterVolumeSpecName: "console-config") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:25:52.527135 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.527096    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:25:52.527135 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.527124    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8" (OuterVolumeSpecName: "kube-api-access-bdpr8") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "kube-api-access-bdpr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:25:52.527135 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.527110    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eabdce04-3368-4fad-986d-99ca981f88bf" (UID: "eabdce04-3368-4fad-986d-99ca981f88bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:25:52.626317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626275    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-console-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626309    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-service-ca\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626321    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-trusted-ca-bundle\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626332    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-oauth-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626346    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eabdce04-3368-4fad-986d-99ca981f88bf-console-serving-cert\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626357    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eabdce04-3368-4fad-986d-99ca981f88bf-oauth-serving-cert\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:52.626555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:52.626368    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdpr8\" (UniqueName: \"kubernetes.io/projected/eabdce04-3368-4fad-986d-99ca981f88bf-kube-api-access-bdpr8\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:25:53.395780 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.395742    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8b7ddc5-sc869"
Jun 11 21:25:53.395780 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.395769    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8b7ddc5-sc869" event={"ID":"eabdce04-3368-4fad-986d-99ca981f88bf","Type":"ContainerDied","Data":"74f0effaf172371d3512efb5a7c664d2a00466c4a61eef8e901d78aa7ebf8fe2"}
Jun 11 21:25:53.396324 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.395832    2570 scope.go:117] "RemoveContainer" containerID="94e5fd130185de92bb87a6d7538055c8bbb86a34cae9b64d842749789ff2fd68"
Jun 11 21:25:53.420571 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.420536    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:25:53.422361 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.422330    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f8b7ddc5-sc869"]
Jun 11 21:25:53.780873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:25:53.780795    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eabdce04-3368-4fad-986d-99ca981f88bf" path="/var/lib/kubelet/pods/eabdce04-3368-4fad-986d-99ca981f88bf/volumes"
Jun 11 21:26:00.118531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.118494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:00.122136 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.122105    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:26:00.122645 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.122612    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry" containerID="cri-o://8dc6a4698857f98d4a503cff2aa4c4be3da756e26bbcd4d938f578b6a1c647ee" gracePeriod=30
Jun 11 21:26:00.122772 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.122705    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline" containerID="cri-o://752bad00ab5e8b3f382fee1833953af31da22b9925c24f55aed88f90d1634871" gracePeriod=30
Jun 11 21:26:00.122772 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.122725    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" containerID="cri-o://6604fbd8e17932a1b2a352ac9a3ddc107d3bc367d415b6fc12616a9faffef93c" gracePeriod=30
Jun 11 21:26:00.122886 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.122707    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" containerID="cri-o://88cd701079ef458a252c187a1fa8178b65358fd970a880196f636d8cf217eacb" gracePeriod=30
Jun 11 21:26:00.215851 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.215821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:00.322122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.322086    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:00.416723 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.416619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:00.506326 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.506249    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:26:00.506823 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.506803    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eabdce04-3368-4fad-986d-99ca981f88bf" containerName="console"
Jun 11 21:26:00.506901 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.506826    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="eabdce04-3368-4fad-986d-99ca981f88bf" containerName="console"
Jun 11 21:26:00.506954 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.506919    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="eabdce04-3368-4fad-986d-99ca981f88bf" containerName="console"
Jun 11 21:26:00.512630 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.512599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.516662 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.516637    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mr6h8\""
Jun 11 21:26:00.533444 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.533401    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:26:00.605182 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.605182 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.605455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wjpt\" (UniqueName: \"kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.605455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.605455 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.605596 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.605503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.620537 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.620502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:00.706687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706687 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wjpt\" (UniqueName: \"kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:00.706740    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:00.706814    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls podName:460f50f9-63f4-4452-8455-0e732bc58b26 nodeName:}" failed. No retries permitted until 2026-06-11 21:26:01.206790026 +0000 UTC m=+645.787725106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls") pod "feast-simple-feast-setup-6f588d8cb4-p86xb" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.706866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.706967 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:00.706955    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:26:00.707241 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:00.706993    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls podName:460f50f9-63f4-4452-8455-0e732bc58b26 nodeName:}" failed. No retries permitted until 2026-06-11 21:26:01.206981659 +0000 UTC m=+645.787916752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls") pod "feast-simple-feast-setup-6f588d8cb4-p86xb" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26") : secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:26:00.707241 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.707158    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.709811 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.709781    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.709937 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.709827    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.719223 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.719191    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wjpt\" (UniqueName: \"kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:00.721174 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:00.721133    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:01.045109 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.045012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:01.210334 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.210297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:01.210797 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.210391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:01.210797 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:01.210503    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:26:01.210797 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:26:01.210563    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls podName:460f50f9-63f4-4452-8455-0e732bc58b26 nodeName:}" failed. No retries permitted until 2026-06-11 21:26:02.210546647 +0000 UTC m=+646.791481727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls") pod "feast-simple-feast-setup-6f588d8cb4-p86xb" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26") : secret "feast-simple-feast-setup-online-tls" not found
Jun 11 21:26:01.213014 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.212993    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:01.379374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.379340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:01.436801 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.436768    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="6604fbd8e17932a1b2a352ac9a3ddc107d3bc367d415b6fc12616a9faffef93c" exitCode=0
Jun 11 21:26:01.436801 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.436791    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="88cd701079ef458a252c187a1fa8178b65358fd970a880196f636d8cf217eacb" exitCode=0
Jun 11 21:26:01.436989 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.436837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"6604fbd8e17932a1b2a352ac9a3ddc107d3bc367d415b6fc12616a9faffef93c"}
Jun 11 21:26:01.436989 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:01.436882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"88cd701079ef458a252c187a1fa8178b65358fd970a880196f636d8cf217eacb"}
Jun 11 21:26:02.219318 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:02.219278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:02.221784 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:02.221757    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-p86xb\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:02.327097 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:02.327055    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:02.475671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:02.475640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:26:02.477141 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:26:02.477114    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod460f50f9_63f4_4452_8455_0e732bc58b26.slice/crio-7a444eae56b718fb6bc5bce85481cfb35304dc4dd7cd8c28642e1f0b52ac1101 WatchSource:0}: Error finding container 7a444eae56b718fb6bc5bce85481cfb35304dc4dd7cd8c28642e1f0b52ac1101: Status 404 returned error can't find the container with id 7a444eae56b718fb6bc5bce85481cfb35304dc4dd7cd8c28642e1f0b52ac1101
Jun 11 21:26:03.446851 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:03.446809    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"}
Jun 11 21:26:03.447229 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:03.446869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"7a444eae56b718fb6bc5bce85481cfb35304dc4dd7cd8c28642e1f0b52ac1101"}
Jun 11 21:26:07.465621 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:07.465540    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5" exitCode=0
Jun 11 21:26:07.465621 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:07.465590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"}
Jun 11 21:26:07.700202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:07.699928    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jun 11 21:26:08.166246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:08.166206    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jun 11 21:26:08.472842 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:08.472755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"}
Jun 11 21:26:13.497061 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:13.496974    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049" exitCode=0
Jun 11 21:26:13.497061 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:13.497046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"}
Jun 11 21:26:14.508088 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:14.508048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"}
Jun 11 21:26:14.508609 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:14.508129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"}
Jun 11 21:26:14.508609 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:14.508152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"}
Jun 11 21:26:14.508609 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:14.508170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerStarted","Data":"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"}
Jun 11 21:26:14.549191 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:14.549123    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podStartSLOduration=14.549097328 podStartE2EDuration="14.549097328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:26:14.546084162 +0000 UTC m=+659.127019263" watchObservedRunningTime="2026-06-11 21:26:14.549097328 +0000 UTC m=+659.130032429"
Jun 11 21:26:17.327368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.327226    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:17.327368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.327308    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:17.327368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.327330    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:17.327368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.327347    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:17.329452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.329416    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Jun 11 21:26:17.329452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.329432    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Jun 11 21:26:17.329452 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.329445    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 11 21:26:17.329710 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.329528    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 11 21:26:17.700623 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:17.700518    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jun 11 21:26:18.166825 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:18.166774    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jun 11 21:26:20.328391 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.328852 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328541    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.328852 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328744    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.328980 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328850    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.328980 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328884    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.329066 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.328902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.329201 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.329187    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.329352 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.329334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.329747 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.329730    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.334733 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.334714    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.540116 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.540087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.543067 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.543039    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:26:20.769209 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:20.769129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:26:27.700383 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:27.700334    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
Jun 11 21:26:27.700920 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:27.700515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:26:28.166769 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:28.166726    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Jun 11 21:26:28.166960 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:28.166855    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:26:30.582688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.582649    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="752bad00ab5e8b3f382fee1833953af31da22b9925c24f55aed88f90d1634871" exitCode=137
Jun 11 21:26:30.582688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.582680    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerID="8dc6a4698857f98d4a503cff2aa4c4be3da756e26bbcd4d938f578b6a1c647ee" exitCode=137
Jun 11 21:26:30.583102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.582713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"752bad00ab5e8b3f382fee1833953af31da22b9925c24f55aed88f90d1634871"}
Jun 11 21:26:30.583102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.582753    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"8dc6a4698857f98d4a503cff2aa4c4be3da756e26bbcd4d938f578b6a1c647ee"}
Jun 11 21:26:30.779590 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.779561    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:26:30.887643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887542    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.887643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887605    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkxkd\" (UniqueName: \"kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.887643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887628    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.887938 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887653    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.887938 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.887938 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.887718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") pod \"1d9ab181-7014-4572-8f00-c714de8ee20e\" (UID: \"1d9ab181-7014-4572-8f00-c714de8ee20e\") "
Jun 11 21:26:30.888234 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.888198    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data" (OuterVolumeSpecName: "feast-data") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:26:30.890200 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.890169    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:26:30.890337 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.890212    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:26:30.890337 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.890232    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls" (OuterVolumeSpecName: "online-tls") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:26:30.890463 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.890448    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd" (OuterVolumeSpecName: "kube-api-access-vkxkd") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "kube-api-access-vkxkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:26:30.890521 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.890485    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d9ab181-7014-4572-8f00-c714de8ee20e" (UID: "1d9ab181-7014-4572-8f00-c714de8ee20e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:26:30.988896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988853    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-offline-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:30.988896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988888    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:30.988896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988898    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:30.989169 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988910    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkxkd\" (UniqueName: \"kubernetes.io/projected/1d9ab181-7014-4572-8f00-c714de8ee20e-kube-api-access-vkxkd\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:30.989169 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988924    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1d9ab181-7014-4572-8f00-c714de8ee20e-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:30.989169 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:30.988934    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1d9ab181-7014-4572-8f00-c714de8ee20e-ui-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:26:31.590469 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.590442    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"
Jun 11 21:26:31.590860 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.590449    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns" event={"ID":"1d9ab181-7014-4572-8f00-c714de8ee20e","Type":"ContainerDied","Data":"d57404d68a7f37571e8fc17aad3f149ed626b6895ee6315611bdb8416a05e65e"}
Jun 11 21:26:31.590860 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.590576    2570 scope.go:117] "RemoveContainer" containerID="6604fbd8e17932a1b2a352ac9a3ddc107d3bc367d415b6fc12616a9faffef93c"
Jun 11 21:26:31.601540 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.601515    2570 scope.go:117] "RemoveContainer" containerID="752bad00ab5e8b3f382fee1833953af31da22b9925c24f55aed88f90d1634871"
Jun 11 21:26:31.610999 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.610977    2570 scope.go:117] "RemoveContainer" containerID="88cd701079ef458a252c187a1fa8178b65358fd970a880196f636d8cf217eacb"
Jun 11 21:26:31.614914 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.614886    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:26:31.619635 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.619607    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-lcbns"]
Jun 11 21:26:31.621023 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.621003    2570 scope.go:117] "RemoveContainer" containerID="8dc6a4698857f98d4a503cff2aa4c4be3da756e26bbcd4d938f578b6a1c647ee"
Jun 11 21:26:31.629330 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.629309    2570 scope.go:117] "RemoveContainer" containerID="5132df7d5a99cf9e82b04836ff3c74f10852a33b150e8c06b1b45cc8e3b83dcb"
Jun 11 21:26:31.637409 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.637388    2570 scope.go:117] "RemoveContainer" containerID="36354acb573bb6fa39d7c00cfe4638d6e5e3f3153baf848e56a6cc425eb4712d"
Jun 11 21:26:31.779946 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:26:31.779909    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" path="/var/lib/kubelet/pods/1d9ab181-7014-4572-8f00-c714de8ee20e/volumes"
Jun 11 21:27:21.808896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:21.808860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:21.909505 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:21.909477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.010272 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.010213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.110965 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.110927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.194158 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.194131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.194861 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.194838    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:27:22.195317 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195302    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="feast-init"
Jun 11 21:27:22.195369 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195321    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="feast-init"
Jun 11 21:27:22.195369 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195337    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="feast-apply"
Jun 11 21:27:22.195369 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195347    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="feast-apply"
Jun 11 21:27:22.195369 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195366    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195374    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195394    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195402    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195413    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195421    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195431    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry"
Jun 11 21:27:22.195488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195440    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry"
Jun 11 21:27:22.195685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195526    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="registry"
Jun 11 21:27:22.195685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195538    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="online"
Jun 11 21:27:22.195685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195548    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="ui"
Jun 11 21:27:22.195685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.195559    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9ab181-7014-4572-8f00-c714de8ee20e" containerName="offline"
Jun 11 21:27:22.200842 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.200823    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.203526 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.203501    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 11 21:27:22.203649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.203566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 11 21:27:22.203649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.203578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 11 21:27:22.204545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.204493    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 11 21:27:22.204545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.204499    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 11 21:27:22.204545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.204493    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-cftwb\""
Jun 11 21:27:22.204761 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.204498    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 11 21:27:22.204970 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.204952    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 11 21:27:22.212513 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.212492    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:27:22.303748 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.303932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.303932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303802    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6ss\" (UniqueName: \"kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.303932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.303932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.303932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.304122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.303939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404546 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6ss\" (UniqueName: \"kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404557    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.404838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.404625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.405069 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.405052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:22.405147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.405112    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.405589 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.405563    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.407163 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.407143    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.407304 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.407275    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.407408 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.407329    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.412910 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.412884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6ss\" (UniqueName: \"kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss\") pod \"feast-simple-feast-remote-setup-7f67c7965c-fjf9k\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.512528 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.512484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:22.655050 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.654991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:27:22.657448 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:27:22.657420    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7125557f_c2f3_4c0e_bb00_3fcf44b3fbc8.slice/crio-ac00c03fca5ec6641bbb92c50feed2c0bbd3716c44d955205ed2f765d7e4349b WatchSource:0}: Error finding container ac00c03fca5ec6641bbb92c50feed2c0bbd3716c44d955205ed2f765d7e4349b: Status 404 returned error can't find the container with id ac00c03fca5ec6641bbb92c50feed2c0bbd3716c44d955205ed2f765d7e4349b
Jun 11 21:27:22.813134 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.813090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"}
Jun 11 21:27:22.813569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:22.813148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"ac00c03fca5ec6641bbb92c50feed2c0bbd3716c44d955205ed2f765d7e4349b"}
Jun 11 21:27:27.834604 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:27.834568    2570 generic.go:356] "Generic (PLEG): container finished" podID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerID="7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b" exitCode=0
Jun 11 21:27:27.835014 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:27.834635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"}
Jun 11 21:27:28.840868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:28.840834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"}
Jun 11 21:27:33.864733 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:33.864700    2570 generic.go:356] "Generic (PLEG): container finished" podID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerID="98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39" exitCode=0
Jun 11 21:27:33.865106 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:33.864776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"}
Jun 11 21:27:34.873656 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:34.873617    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"}
Jun 11 21:27:34.874024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:34.873685    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"}
Jun 11 21:27:34.874024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:34.873709    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerStarted","Data":"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"}
Jun 11 21:27:34.905835 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:34.905766    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podStartSLOduration=12.905744244 podStartE2EDuration="12.905744244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:34.903443285 +0000 UTC m=+739.484378407" watchObservedRunningTime="2026-06-11 21:27:34.905744244 +0000 UTC m=+739.486679347"
Jun 11 21:27:34.941275 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:34.941230    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:27:37.512952 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.512902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:37.513447 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.512976    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:37.513447 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.512997    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:37.514508 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.514475    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 11 21:27:37.514604 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.514497    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Jun 11 21:27:37.514604 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:37.514521    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 11 21:27:40.514016 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.513985    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.514406 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.514103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.514531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.514512    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.514584 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.514543    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.514915 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.514894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.514988 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.514947    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.518083 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.518063    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.901984 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.901949    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:40.904859 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:40.904830    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:27:41.312618 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:27:41.312536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:43.438580 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.438489    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:43.439332 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.439309    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:28:43.439569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.439542    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online" containerID="cri-o://33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727" gracePeriod=30
Jun 11 21:28:43.439824 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.439564    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui" containerID="cri-o://035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02" gracePeriod=30
Jun 11 21:28:43.439911 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.439592    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="offline" containerID="cri-o://31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f" gracePeriod=30
Jun 11 21:28:43.541019 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.540986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:43.550630 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.550600    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:28:43.550881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.550839    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="registry" containerID="cri-o://851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03" gracePeriod=30
Jun 11 21:28:43.550981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.550891    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online" containerID="cri-o://0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd" gracePeriod=30
Jun 11 21:28:43.550981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.550887    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="offline" containerID="cri-o://100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b" gracePeriod=30
Jun 11 21:28:43.550981 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.550910    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui" containerID="cri-o://169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8" gracePeriod=30
Jun 11 21:28:43.593881 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.593842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:43.647315 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:43.647284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:44.167823 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:44.167789    2570 generic.go:356] "Generic (PLEG): container finished" podID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerID="035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02" exitCode=0
Jun 11 21:28:44.167970 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:44.167862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"}
Jun 11 21:28:45.175791 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.175763    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8" exitCode=0
Jun 11 21:28:45.175791 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.175786    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd" exitCode=0
Jun 11 21:28:45.176246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.175834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"}
Jun 11 21:28:45.176246 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.175883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"}
Jun 11 21:28:45.178477 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.178456    2570 generic.go:356] "Generic (PLEG): container finished" podID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerID="33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727" exitCode=0
Jun 11 21:28:45.178605 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:45.178485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"}
Jun 11 21:28:48.723709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:48.723668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:28:50.329295 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:50.329239    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 11 21:28:50.515240 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:50.515196    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 11 21:28:50.540478 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:50.540436    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 11 21:28:50.902753 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:28:50.902704    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 11 21:29:00.329188 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:00.329134    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 11 21:29:00.515200 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:00.515155    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 11 21:29:00.541014 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:00.540970    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 11 21:29:00.902781 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:00.902737    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 11 21:29:10.329149 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.329097    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Jun 11 21:29:10.329663 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.329247    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:29:10.515609 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.515563    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Jun 11 21:29:10.515801 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.515700    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:29:10.540396 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.540350    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Jun 11 21:29:10.540551 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.540481    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:29:10.547579 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.547546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:10.599072 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.598992    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:10.903155 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.903067    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jun 11 21:29:10.903322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:10.903180    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:29:14.100655 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.100607    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:29:14.176191 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176156    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176191 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176229    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176288    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl6ss\" (UniqueName: \"kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176460 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176369    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls\") pod \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\" (UID: \"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8\") "
Jun 11 21:29:14.176777 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176721    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 21:29:14.176891 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.176791    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data" (OuterVolumeSpecName: "feast-data") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:29:14.180866 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.180828    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls" (OuterVolumeSpecName: "online-tls") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.180866 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.180842    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.181033 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.180898    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss" (OuterVolumeSpecName: "kube-api-access-fl6ss") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "kube-api-access-fl6ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:29:14.181033 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.180942    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" (UID: "7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.212382 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.212312    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:29:14.276826 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.276781    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277031 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.276862    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277031 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.276891    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277197 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277067    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277197 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277135    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wjpt\" (UniqueName: \"kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277197 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") pod \"460f50f9-63f4-4452-8455-0e732bc58b26\" (UID: \"460f50f9-63f4-4452-8455-0e732bc58b26\") "
Jun 11 21:29:14.277497 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277462    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl6ss\" (UniqueName: \"kubernetes.io/projected/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-kube-api-access-fl6ss\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.277497 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277487    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.277684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277504    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-offline-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.277684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277523    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.277684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277536    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-ui-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.277684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277547    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.278056 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.277628    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data" (OuterVolumeSpecName: "feast-data") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:29:14.279322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.279293    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt" (OuterVolumeSpecName: "kube-api-access-6wjpt") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "kube-api-access-6wjpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:29:14.279412 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.279346    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.279412 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.279368    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.279706 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.279688    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls" (OuterVolumeSpecName: "online-tls") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.279756 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.279721    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "460f50f9-63f4-4452-8455-0e732bc58b26" (UID: "460f50f9-63f4-4452-8455-0e732bc58b26"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:29:14.309592 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309564    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b" exitCode=137
Jun 11 21:29:14.309592 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309587    2570 generic.go:356] "Generic (PLEG): container finished" podID="460f50f9-63f4-4452-8455-0e732bc58b26" containerID="851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03" exitCode=137
Jun 11 21:29:14.309794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309625    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"
Jun 11 21:29:14.309794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"}
Jun 11 21:29:14.309794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"}
Jun 11 21:29:14.309794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb" event={"ID":"460f50f9-63f4-4452-8455-0e732bc58b26","Type":"ContainerDied","Data":"7a444eae56b718fb6bc5bce85481cfb35304dc4dd7cd8c28642e1f0b52ac1101"}
Jun 11 21:29:14.309794 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.309734    2570 scope.go:117] "RemoveContainer" containerID="169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"
Jun 11 21:29:14.312752 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.312728    2570 generic.go:356] "Generic (PLEG): container finished" podID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerID="31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f" exitCode=137
Jun 11 21:29:14.312868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.312789    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"
Jun 11 21:29:14.312868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.312808    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"}
Jun 11 21:29:14.312868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.312846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k" event={"ID":"7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8","Type":"ContainerDied","Data":"ac00c03fca5ec6641bbb92c50feed2c0bbd3716c44d955205ed2f765d7e4349b"}
Jun 11 21:29:14.320707 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.320688    2570 scope.go:117] "RemoveContainer" containerID="100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"
Jun 11 21:29:14.329380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.329354    2570 scope.go:117] "RemoveContainer" containerID="0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"
Jun 11 21:29:14.337688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.337665    2570 scope.go:117] "RemoveContainer" containerID="851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"
Jun 11 21:29:14.345615 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.345595    2570 scope.go:117] "RemoveContainer" containerID="fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"
Jun 11 21:29:14.348886 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.348866    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:29:14.353757 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.353737    2570 scope.go:117] "RemoveContainer" containerID="5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"
Jun 11 21:29:14.360465 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.360442    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-p86xb"]
Jun 11 21:29:14.362873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.362852    2570 scope.go:117] "RemoveContainer" containerID="169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"
Jun 11 21:29:14.363172 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.363152    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8\": container with ID starting with 169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8 not found: ID does not exist" containerID="169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"
Jun 11 21:29:14.363240 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363179    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"} err="failed to get container status \"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8\": rpc error: code = NotFound desc = could not find container \"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8\": container with ID starting with 169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8 not found: ID does not exist"
Jun 11 21:29:14.363240 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363199    2570 scope.go:117] "RemoveContainer" containerID="100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"
Jun 11 21:29:14.363480 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.363457    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b\": container with ID starting with 100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b not found: ID does not exist" containerID="100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"
Jun 11 21:29:14.363528 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363483    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"} err="failed to get container status \"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b\": rpc error: code = NotFound desc = could not find container \"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b\": container with ID starting with 100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b not found: ID does not exist"
Jun 11 21:29:14.363528 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363498    2570 scope.go:117] "RemoveContainer" containerID="0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"
Jun 11 21:29:14.363716 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.363701    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd\": container with ID starting with 0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd not found: ID does not exist" containerID="0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"
Jun 11 21:29:14.363767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363718    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"} err="failed to get container status \"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd\": rpc error: code = NotFound desc = could not find container \"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd\": container with ID starting with 0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd not found: ID does not exist"
Jun 11 21:29:14.363767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363732    2570 scope.go:117] "RemoveContainer" containerID="851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"
Jun 11 21:29:14.363977 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.363962    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03\": container with ID starting with 851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03 not found: ID does not exist" containerID="851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"
Jun 11 21:29:14.364024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363982    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"} err="failed to get container status \"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03\": rpc error: code = NotFound desc = could not find container \"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03\": container with ID starting with 851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03 not found: ID does not exist"
Jun 11 21:29:14.364024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.363993    2570 scope.go:117] "RemoveContainer" containerID="fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"
Jun 11 21:29:14.364245 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.364210    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049\": container with ID starting with fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049 not found: ID does not exist" containerID="fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"
Jun 11 21:29:14.364374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364269    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"} err="failed to get container status \"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049\": rpc error: code = NotFound desc = could not find container \"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049\": container with ID starting with fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049 not found: ID does not exist"
Jun 11 21:29:14.364374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364291    2570 scope.go:117] "RemoveContainer" containerID="5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"
Jun 11 21:29:14.364538 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.364521    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5\": container with ID starting with 5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5 not found: ID does not exist" containerID="5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"
Jun 11 21:29:14.364613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364541    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"} err="failed to get container status \"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5\": rpc error: code = NotFound desc = could not find container \"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5\": container with ID starting with 5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5 not found: ID does not exist"
Jun 11 21:29:14.364613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364559    2570 scope.go:117] "RemoveContainer" containerID="169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"
Jun 11 21:29:14.364767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364751    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8"} err="failed to get container status \"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8\": rpc error: code = NotFound desc = could not find container \"169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8\": container with ID starting with 169e60fe293e7d36eb87fe90a48128c0e08261a56d244b6d046d02a552a667f8 not found: ID does not exist"
Jun 11 21:29:14.364808 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364769    2570 scope.go:117] "RemoveContainer" containerID="100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"
Jun 11 21:29:14.365001 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.364983    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b"} err="failed to get container status \"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b\": rpc error: code = NotFound desc = could not find container \"100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b\": container with ID starting with 100d0a6a9ec1782b9d0ac74495118c7c347215cf0b5273004d5b888eead0057b not found: ID does not exist"
Jun 11 21:29:14.365038 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365003    2570 scope.go:117] "RemoveContainer" containerID="0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"
Jun 11 21:29:14.365208 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365188    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd"} err="failed to get container status \"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd\": rpc error: code = NotFound desc = could not find container \"0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd\": container with ID starting with 0c41e1b9b7d9671f9dfc35a103d5deec98f394f6db278d38423bf976c77e74fd not found: ID does not exist"
Jun 11 21:29:14.365247 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365215    2570 scope.go:117] "RemoveContainer" containerID="851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"
Jun 11 21:29:14.365417 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365398    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03"} err="failed to get container status \"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03\": rpc error: code = NotFound desc = could not find container \"851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03\": container with ID starting with 851206305d8f4e49da4d2851e84c72647224f9c746fcc2a07584ad80f30fbc03 not found: ID does not exist"
Jun 11 21:29:14.365464 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365420    2570 scope.go:117] "RemoveContainer" containerID="fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"
Jun 11 21:29:14.365636 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365619    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049"} err="failed to get container status \"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049\": rpc error: code = NotFound desc = could not find container \"fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049\": container with ID starting with fc2a25ca737ae9ce2f51a4944706f4ffc7d1021c5b01c493ff81c23543af0049 not found: ID does not exist"
Jun 11 21:29:14.365673 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365637    2570 scope.go:117] "RemoveContainer" containerID="5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"
Jun 11 21:29:14.365838 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365820    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5"} err="failed to get container status \"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5\": rpc error: code = NotFound desc = could not find container \"5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5\": container with ID starting with 5b7d721cd7657cfd2525116b04a1b54ef3b0878053a73c10bb8fe09f26a33ae5 not found: ID does not exist"
Jun 11 21:29:14.365884 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.365839    2570 scope.go:117] "RemoveContainer" containerID="035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"
Jun 11 21:29:14.374080 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.374061    2570 scope.go:117] "RemoveContainer" containerID="31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"
Jun 11 21:29:14.378463 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378436    2570 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-ui-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.378463 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378461    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460f50f9-63f4-4452-8455-0e732bc58b26-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.378603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378472    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wjpt\" (UniqueName: \"kubernetes.io/projected/460f50f9-63f4-4452-8455-0e732bc58b26-kube-api-access-6wjpt\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.378603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378481    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.378603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378491    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-offline-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.378603 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.378498    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460f50f9-63f4-4452-8455-0e732bc58b26-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:29:14.382192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.382171    2570 scope.go:117] "RemoveContainer" containerID="33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"
Jun 11 21:29:14.388435 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.388410    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:29:14.391387 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.391335    2570 scope.go:117] "RemoveContainer" containerID="98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"
Jun 11 21:29:14.393158 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.393139    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-fjf9k"]
Jun 11 21:29:14.399247 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.399230    2570 scope.go:117] "RemoveContainer" containerID="7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"
Jun 11 21:29:14.406805 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.406790    2570 scope.go:117] "RemoveContainer" containerID="035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"
Jun 11 21:29:14.407069 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.407046    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02\": container with ID starting with 035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02 not found: ID does not exist" containerID="035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"
Jun 11 21:29:14.407157 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407077    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02"} err="failed to get container status \"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02\": rpc error: code = NotFound desc = could not find container \"035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02\": container with ID starting with 035c69849b2bfc4322f6765c2cb2ba724f84c3ead718853d88a7c1136f225b02 not found: ID does not exist"
Jun 11 21:29:14.407157 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407095    2570 scope.go:117] "RemoveContainer" containerID="31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"
Jun 11 21:29:14.407382 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.407365    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f\": container with ID starting with 31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f not found: ID does not exist" containerID="31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"
Jun 11 21:29:14.407429 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407387    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f"} err="failed to get container status \"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f\": rpc error: code = NotFound desc = could not find container \"31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f\": container with ID starting with 31e388d879e0f2db19622509fd865a34283edcab6865c3620e5b5f429f75ab0f not found: ID does not exist"
Jun 11 21:29:14.407429 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407408    2570 scope.go:117] "RemoveContainer" containerID="33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"
Jun 11 21:29:14.407638 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.407620    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727\": container with ID starting with 33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727 not found: ID does not exist" containerID="33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"
Jun 11 21:29:14.407686 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407644    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727"} err="failed to get container status \"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727\": rpc error: code = NotFound desc = could not find container \"33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727\": container with ID starting with 33413cd01b9c2e2386ecfdac7a9d778a268c644adcb1907b0e1aecad996a0727 not found: ID does not exist"
Jun 11 21:29:14.407686 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407675    2570 scope.go:117] "RemoveContainer" containerID="98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"
Jun 11 21:29:14.407908 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.407894    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39\": container with ID starting with 98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39 not found: ID does not exist" containerID="98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"
Jun 11 21:29:14.407964 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407910    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39"} err="failed to get container status \"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39\": rpc error: code = NotFound desc = could not find container \"98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39\": container with ID starting with 98f9c697821945b3b1e30651a7ba48fbb591fbb48757752cbd79cc04bdfa6f39 not found: ID does not exist"
Jun 11 21:29:14.407964 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.407921    2570 scope.go:117] "RemoveContainer" containerID="7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"
Jun 11 21:29:14.408167 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:14.408150    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b\": container with ID starting with 7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b not found: ID does not exist" containerID="7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"
Jun 11 21:29:14.408206 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:14.408173    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b"} err="failed to get container status \"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b\": rpc error: code = NotFound desc = could not find container \"7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b\": container with ID starting with 7d807f0d46feaeee9c2241913fdfcb1aa96c7583f32ffdb1de536c93db15a48b not found: ID does not exist"
Jun 11 21:29:15.783107 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:15.782638    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" path="/var/lib/kubelet/pods/460f50f9-63f4-4452-8455-0e732bc58b26/volumes"
Jun 11 21:29:15.784440 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:15.784398    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" path="/var/lib/kubelet/pods/7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8/volumes"
Jun 11 21:29:26.207917 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.207878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:26.421965 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.421923    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:29:26.422340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422321    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422342    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422355    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="feast-apply"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422363    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="feast-apply"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422373    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422381    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422389    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422398    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422412    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="feast-apply"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422420    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="feast-apply"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422431    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="feast-init"
Jun 11 21:29:26.422437 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422439    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="feast-init"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422456    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422465    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422484    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="feast-init"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422493    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="feast-init"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422508    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422516    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422527    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="registry"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422534    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="registry"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422544    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422551    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422662    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="online"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422674    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422683    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="offline"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422693    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="ui"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422704    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="online"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422712    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7125557f-c2f3-4c0e-bb00-3fcf44b3fbc8" containerName="ui"
Jun 11 21:29:26.422929 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.422721    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="460f50f9-63f4-4452-8455-0e732bc58b26" containerName="registry"
Jun 11 21:29:26.427972 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.427949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.430376 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.430354    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 21:29:26.430481 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.430385    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-99kr4\""
Jun 11 21:29:26.431622 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.431600    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 11 21:29:26.431752 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.431656    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 21:29:26.433494 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.433470    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:29:26.455688 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.455651    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:29:26.458896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.458837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:29:26.460682 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.460645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:26.466532 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.466388    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:29:26.516289 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.516247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:26.580581 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.580541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcg72\" (UniqueName: \"kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72\") pod \"redis-69bbd798b6-n6g9g\" (UID: \"61dcec6a-5f73-41a0-b236-a10b916822c8\") " pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:29:26.580581 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.580582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf279\" (UniqueName: \"kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.580773 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.580689    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.681130 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.681088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcg72\" (UniqueName: \"kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72\") pod \"redis-69bbd798b6-n6g9g\" (UID: \"61dcec6a-5f73-41a0-b236-a10b916822c8\") " pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:29:26.681130 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.681131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf279\" (UniqueName: \"kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.681431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.681246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.681620 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.681602    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.689555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.689522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf279\" (UniqueName: \"kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279\") pod \"postgres-864846d4f5-v2t56\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") " pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.689659 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.689617    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcg72\" (UniqueName: \"kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72\") pod \"redis-69bbd798b6-n6g9g\" (UID: \"61dcec6a-5f73-41a0-b236-a10b916822c8\") " pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:29:26.752523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.752432    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:29:26.770044 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.770019    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:29:26.895202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.895174    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:29:26.897377 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:29:26.897350    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38bf5668_58ad_4217_be13_b306ca5916ba.slice/crio-50e945877c3dbe9a71cacf120d4d26f550ed3640f7dc390906fc0ccc19ac0069 WatchSource:0}: Error finding container 50e945877c3dbe9a71cacf120d4d26f550ed3640f7dc390906fc0ccc19ac0069: Status 404 returned error can't find the container with id 50e945877c3dbe9a71cacf120d4d26f550ed3640f7dc390906fc0ccc19ac0069
Jun 11 21:29:26.899268 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.899229    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 21:29:26.918070 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:26.917898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:29:26.920650 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:29:26.920613    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61dcec6a_5f73_41a0_b236_a10b916822c8.slice/crio-d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a WatchSource:0}: Error finding container d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a: Status 404 returned error can't find the container with id d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a
Jun 11 21:29:27.367757 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:27.367706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-v2t56" event={"ID":"38bf5668-58ad-4217-be13-b306ca5916ba","Type":"ContainerStarted","Data":"50e945877c3dbe9a71cacf120d4d26f550ed3640f7dc390906fc0ccc19ac0069"}
Jun 11 21:29:27.368851 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:27.368829    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n6g9g" event={"ID":"61dcec6a-5f73-41a0-b236-a10b916822c8","Type":"ContainerStarted","Data":"d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a"}
Jun 11 21:29:29.380768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:29.380730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n6g9g" event={"ID":"61dcec6a-5f73-41a0-b236-a10b916822c8","Type":"ContainerStarted","Data":"0e2a9a5ec5d0d2e15e810bf5956050c00c40075073297f533a9d61f4c5c4ae49"}
Jun 11 21:29:29.396466 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:29.396404    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-n6g9g" podStartSLOduration=1.5824766239999999 podStartE2EDuration="3.396381772s" totalImagesPullingTime="1.813905148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:29.39451985 +0000 UTC m=+853.975454953" watchObservedRunningTime="2026-06-11 21:29:29.396381772 +0000 UTC m=+853.977316906"
Jun 11 21:29:33.402091 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:33.402052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-v2t56" event={"ID":"38bf5668-58ad-4217-be13-b306ca5916ba","Type":"ContainerStarted","Data":"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"}
Jun 11 21:29:33.420268 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:33.420202    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-v2t56" podStartSLOduration=1.5211253390000001 podStartE2EDuration="7.420183232s" totalImagesPullingTime="5.899057893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:33.419381944 +0000 UTC m=+858.000317046" watchObservedRunningTime="2026-06-11 21:29:33.420183232 +0000 UTC m=+858.001118333"
Jun 11 21:29:36.921895 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:36.921860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:37.023020 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.022971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:37.110182 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.110146    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:29:37.113966 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.113944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.116569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.116371    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 11 21:29:37.116569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.116399    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 11 21:29:37.116569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.116439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 11 21:29:37.116569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.116439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 11 21:29:37.116569 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.116372    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-2r82d\""
Jun 11 21:29:37.124896 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.124861    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:29:37.195000 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.194908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:37.273898 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.273797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p2zn\" (UniqueName: \"kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.274093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.273932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.274093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.273973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.274093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.274045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.274093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.274064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.292967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.292933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:37.375078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375035    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.375078 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.375407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2zn\" (UniqueName: \"kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.375407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.375407 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:37.375281    2570 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jun 11 21:29:37.375407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.375407 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:29:37.375378    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls podName:a4048b4c-0344-480a-bcf4-f89af1db42e0 nodeName:}" failed. No retries permitted until 2026-06-11 21:29:37.87535522 +0000 UTC m=+862.456290302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls") pod "feast-credit-scoring-6b454f755b-hdfpw" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0") : secret "feast-credit-scoring-registry-tls" not found
Jun 11 21:29:37.375704 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.375681    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.377961 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.377936    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.378084 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.377936    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.385431 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.385398    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p2zn\" (UniqueName: \"kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.717562 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.717529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:29:37.879668 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.879640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:37.882221 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:37.882188    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") pod \"feast-credit-scoring-6b454f755b-hdfpw\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:38.025721 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:38.025619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:38.172349 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:38.170480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:29:38.427311 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:38.427157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"9e74b323763514159f541e6763fb5932e6e7cdff944e5457f8476d3d0ea5c20c"}
Jun 11 21:29:38.427519 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:38.427374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"bd41b5eea0ad1dde791bde4e77a058e1d6ad7714aff0bd01d308d52b58e0bfd6"}
Jun 11 21:29:39.432810 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:39.432722    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerID="9e74b323763514159f541e6763fb5932e6e7cdff944e5457f8476d3d0ea5c20c" exitCode=0
Jun 11 21:29:39.433167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:39.432814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"9e74b323763514159f541e6763fb5932e6e7cdff944e5457f8476d3d0ea5c20c"}
Jun 11 21:29:40.438923 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:40.438880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"a99bc216b033cad9a253e2cb081b8b14671a6b6b3ef36450ee9071a29e455adb"}
Jun 11 21:29:46.465499 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:46.465462    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerID="a99bc216b033cad9a253e2cb081b8b14671a6b6b3ef36450ee9071a29e455adb" exitCode=0
Jun 11 21:29:46.465887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:46.465541    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"a99bc216b033cad9a253e2cb081b8b14671a6b6b3ef36450ee9071a29e455adb"}
Jun 11 21:29:47.474347 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:47.474306    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"deb8185015944f7412bceaa54e2460e91e975c74db401066cd3c5a42ffc2b82c"}
Jun 11 21:29:47.474995 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:47.474389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"bcfd62e3d538fb7527c480c137852bb16fa88628f6141d69300f88ed403b1f28"}
Jun 11 21:29:47.474995 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:47.474418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerStarted","Data":"809c838c6757c6d3ca9b147a0d1f34cdbdfea2f0e890d6551299b743324f5b52"}
Jun 11 21:29:47.503453 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:47.503381    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podStartSLOduration=10.503357314 podStartE2EDuration="10.503357314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:47.501670954 +0000 UTC m=+872.082606056" watchObservedRunningTime="2026-06-11 21:29:47.503357314 +0000 UTC m=+872.084292415"
Jun 11 21:29:48.026378 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:48.026334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:48.026567 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:48.026421    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:48.026567 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:48.026448    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:50.026550 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.026501    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:50.026972 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.026597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:50.026972 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.026623    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:50.028661 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.028625    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jun 11 21:29:50.028768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.028652    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Jun 11 21:29:50.028768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:50.028665    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 11 21:29:53.026868 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:53.026818    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jun 11 21:29:53.027540 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:53.027515    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:53.028788 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:53.028766    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:53.032360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:53.032336    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:53.507943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:53.507913    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:56.026224 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:56.026179    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jun 11 21:29:59.026610 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:59.026570    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:59.027441 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:59.027420    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:29:59.367417 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:29:59.367380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:30:15.792650 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:30:15.792563    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:30:15.796555 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:30:15.796534    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:30:15.798379 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:30:15.798358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:30:15.801597 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:30:15.801575    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:31:00.559247 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:00.559212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:05.532887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.532848    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:31:05.533319 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.533140    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry" containerID="cri-o://809c838c6757c6d3ca9b147a0d1f34cdbdfea2f0e890d6551299b743324f5b52" gracePeriod=30
Jun 11 21:31:05.533319 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.533207    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="offline" containerID="cri-o://deb8185015944f7412bceaa54e2460e91e975c74db401066cd3c5a42ffc2b82c" gracePeriod=30
Jun 11 21:31:05.533424 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.533207    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online" containerID="cri-o://bcfd62e3d538fb7527c480c137852bb16fa88628f6141d69300f88ed403b1f28" gracePeriod=30
Jun 11 21:31:05.548649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.548620    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:31:05.548798 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.548785    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-v2t56" podUID="38bf5668-58ad-4217-be13-b306ca5916ba" containerName="postgres" containerID="cri-o://06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d" gracePeriod=30
Jun 11 21:31:05.553383 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.553359    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:31:05.553570 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.553542    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-n6g9g" podUID="61dcec6a-5f73-41a0-b236-a10b916822c8" containerName="redis" containerID="cri-o://0e2a9a5ec5d0d2e15e810bf5956050c00c40075073297f533a9d61f4c5c4ae49" gracePeriod=30
Jun 11 21:31:05.597201 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.597176    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:05.798367 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.798336    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:31:05.826782 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.826747    2570 generic.go:356] "Generic (PLEG): container finished" podID="38bf5668-58ad-4217-be13-b306ca5916ba" containerID="06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d" exitCode=0
Jun 11 21:31:05.826943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.826797    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-v2t56"
Jun 11 21:31:05.826943 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.826921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-v2t56" event={"ID":"38bf5668-58ad-4217-be13-b306ca5916ba","Type":"ContainerDied","Data":"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"}
Jun 11 21:31:05.827069 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.826954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-v2t56" event={"ID":"38bf5668-58ad-4217-be13-b306ca5916ba","Type":"ContainerDied","Data":"50e945877c3dbe9a71cacf120d4d26f550ed3640f7dc390906fc0ccc19ac0069"}
Jun 11 21:31:05.827069 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.826975    2570 scope.go:117] "RemoveContainer" containerID="06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"
Jun 11 21:31:05.828471 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.828448    2570 generic.go:356] "Generic (PLEG): container finished" podID="61dcec6a-5f73-41a0-b236-a10b916822c8" containerID="0e2a9a5ec5d0d2e15e810bf5956050c00c40075073297f533a9d61f4c5c4ae49" exitCode=0
Jun 11 21:31:05.828586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.828493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n6g9g" event={"ID":"61dcec6a-5f73-41a0-b236-a10b916822c8","Type":"ContainerDied","Data":"0e2a9a5ec5d0d2e15e810bf5956050c00c40075073297f533a9d61f4c5c4ae49"}
Jun 11 21:31:05.828586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.828523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n6g9g" event={"ID":"61dcec6a-5f73-41a0-b236-a10b916822c8","Type":"ContainerDied","Data":"d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a"}
Jun 11 21:31:05.828586 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.828539    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d41c88d7fa69bf44f1c7ccc720ed3e882adf144faffda6550854743a9e7c200a"
Jun 11 21:31:05.833591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.833571    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:31:05.835912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.835888    2570 scope.go:117] "RemoveContainer" containerID="06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"
Jun 11 21:31:05.836198 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:31:05.836175    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d\": container with ID starting with 06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d not found: ID does not exist" containerID="06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"
Jun 11 21:31:05.836415 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.836206    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d"} err="failed to get container status \"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d\": rpc error: code = NotFound desc = could not find container \"06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d\": container with ID starting with 06ef87adfcd06212479cba6c51a938cae3f1de9f621968b240f7d1de93c78e5d not found: ID does not exist"
Jun 11 21:31:05.937523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.937490    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcg72\" (UniqueName: \"kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72\") pod \"61dcec6a-5f73-41a0-b236-a10b916822c8\" (UID: \"61dcec6a-5f73-41a0-b236-a10b916822c8\") "
Jun 11 21:31:05.937694 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.937588    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf279\" (UniqueName: \"kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279\") pod \"38bf5668-58ad-4217-be13-b306ca5916ba\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") "
Jun 11 21:31:05.937694 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.937614    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata\") pod \"38bf5668-58ad-4217-be13-b306ca5916ba\" (UID: \"38bf5668-58ad-4217-be13-b306ca5916ba\") "
Jun 11 21:31:05.939783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.939750    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279" (OuterVolumeSpecName: "kube-api-access-jf279") pod "38bf5668-58ad-4217-be13-b306ca5916ba" (UID: "38bf5668-58ad-4217-be13-b306ca5916ba"). InnerVolumeSpecName "kube-api-access-jf279". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:31:05.939783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.939763    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72" (OuterVolumeSpecName: "kube-api-access-tcg72") pod "61dcec6a-5f73-41a0-b236-a10b916822c8" (UID: "61dcec6a-5f73-41a0-b236-a10b916822c8"). InnerVolumeSpecName "kube-api-access-tcg72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:31:05.967334 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:05.967294    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "38bf5668-58ad-4217-be13-b306ca5916ba" (UID: "38bf5668-58ad-4217-be13-b306ca5916ba"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:31:06.039214 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.039124    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf279\" (UniqueName: \"kubernetes.io/projected/38bf5668-58ad-4217-be13-b306ca5916ba-kube-api-access-jf279\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:06.039214 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.039156    2570 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/38bf5668-58ad-4217-be13-b306ca5916ba-postgresdata\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:06.039214 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.039167    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcg72\" (UniqueName: \"kubernetes.io/projected/61dcec6a-5f73-41a0-b236-a10b916822c8-kube-api-access-tcg72\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:06.148623 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.148589    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:31:06.153050 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.153020    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-v2t56"]
Jun 11 21:31:06.835601 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.835567    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerID="bcfd62e3d538fb7527c480c137852bb16fa88628f6141d69300f88ed403b1f28" exitCode=0
Jun 11 21:31:06.836082 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.835641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"bcfd62e3d538fb7527c480c137852bb16fa88628f6141d69300f88ed403b1f28"}
Jun 11 21:31:06.836082 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.835743    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n6g9g"
Jun 11 21:31:06.855315 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.855227    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:31:06.860708 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:06.860682    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n6g9g"]
Jun 11 21:31:07.781096 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:07.781050    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38bf5668-58ad-4217-be13-b306ca5916ba" path="/var/lib/kubelet/pods/38bf5668-58ad-4217-be13-b306ca5916ba/volumes"
Jun 11 21:31:07.781503 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:07.781484    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61dcec6a-5f73-41a0-b236-a10b916822c8" path="/var/lib/kubelet/pods/61dcec6a-5f73-41a0-b236-a10b916822c8/volumes"
Jun 11 21:31:13.505492 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:13.505434    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 11 21:31:17.949728 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:17.949686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:23.505979 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:23.505934    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 11 21:31:33.505576 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:33.505474    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 11 21:31:33.505961 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:33.505608    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:31:35.960469 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:35.960438    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerID="deb8185015944f7412bceaa54e2460e91e975c74db401066cd3c5a42ffc2b82c" exitCode=137
Jun 11 21:31:35.960469 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:35.960461    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerID="809c838c6757c6d3ca9b147a0d1f34cdbdfea2f0e890d6551299b743324f5b52" exitCode=137
Jun 11 21:31:35.960893 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:35.960518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"deb8185015944f7412bceaa54e2460e91e975c74db401066cd3c5a42ffc2b82c"}
Jun 11 21:31:35.960893 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:35.960576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"809c838c6757c6d3ca9b147a0d1f34cdbdfea2f0e890d6551299b743324f5b52"}
Jun 11 21:31:36.200426 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.200395    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:31:36.294591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.294497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls\") pod \"a4048b4c-0344-480a-bcf4-f89af1db42e0\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") "
Jun 11 21:31:36.294591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.294560    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p2zn\" (UniqueName: \"kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn\") pod \"a4048b4c-0344-480a-bcf4-f89af1db42e0\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") "
Jun 11 21:31:36.294832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.294606    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls\") pod \"a4048b4c-0344-480a-bcf4-f89af1db42e0\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") "
Jun 11 21:31:36.294832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.294636    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") pod \"a4048b4c-0344-480a-bcf4-f89af1db42e0\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") "
Jun 11 21:31:36.294832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.294676    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data\") pod \"a4048b4c-0344-480a-bcf4-f89af1db42e0\" (UID: \"a4048b4c-0344-480a-bcf4-f89af1db42e0\") "
Jun 11 21:31:36.296932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.296893    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls" (OuterVolumeSpecName: "online-tls") pod "a4048b4c-0344-480a-bcf4-f89af1db42e0" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:31:36.297074 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.296900    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn" (OuterVolumeSpecName: "kube-api-access-5p2zn") pod "a4048b4c-0344-480a-bcf4-f89af1db42e0" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0"). InnerVolumeSpecName "kube-api-access-5p2zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:31:36.297074 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.296971    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a4048b4c-0344-480a-bcf4-f89af1db42e0" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:31:36.297190 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.297155    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a4048b4c-0344-480a-bcf4-f89af1db42e0" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:31:36.304005 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.303965    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data" (OuterVolumeSpecName: "feast-data") pod "a4048b4c-0344-480a-bcf4-f89af1db42e0" (UID: "a4048b4c-0344-480a-bcf4-f89af1db42e0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:31:36.395547 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.395504    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:36.395547 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.395540    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p2zn\" (UniqueName: \"kubernetes.io/projected/a4048b4c-0344-480a-bcf4-f89af1db42e0-kube-api-access-5p2zn\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:36.395547 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.395553    2570 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-offline-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:36.395789 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.395562    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4048b4c-0344-480a-bcf4-f89af1db42e0-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:36.395789 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.395569    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4048b4c-0344-480a-bcf4-f89af1db42e0-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:31:36.967531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.967500    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"
Jun 11 21:31:36.967531 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.967520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw" event={"ID":"a4048b4c-0344-480a-bcf4-f89af1db42e0","Type":"ContainerDied","Data":"bd41b5eea0ad1dde791bde4e77a058e1d6ad7714aff0bd01d308d52b58e0bfd6"}
Jun 11 21:31:36.967987 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.967592    2570 scope.go:117] "RemoveContainer" containerID="deb8185015944f7412bceaa54e2460e91e975c74db401066cd3c5a42ffc2b82c"
Jun 11 21:31:36.980433 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.980409    2570 scope.go:117] "RemoveContainer" containerID="bcfd62e3d538fb7527c480c137852bb16fa88628f6141d69300f88ed403b1f28"
Jun 11 21:31:36.988993 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.988970    2570 scope.go:117] "RemoveContainer" containerID="809c838c6757c6d3ca9b147a0d1f34cdbdfea2f0e890d6551299b743324f5b52"
Jun 11 21:31:36.992556 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.992531    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:31:36.998001 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.997970    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-hdfpw"]
Jun 11 21:31:36.998709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:36.998687    2570 scope.go:117] "RemoveContainer" containerID="a99bc216b033cad9a253e2cb081b8b14671a6b6b3ef36450ee9071a29e455adb"
Jun 11 21:31:37.007499 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:37.007451    2570 scope.go:117] "RemoveContainer" containerID="9e74b323763514159f541e6763fb5932e6e7cdff944e5457f8476d3d0ea5c20c"
Jun 11 21:31:37.781157 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:37.781125    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" path="/var/lib/kubelet/pods/a4048b4c-0344-480a-bcf4-f89af1db42e0/volumes"
Jun 11 21:31:43.368822 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:43.368774    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:43.472552 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:43.472517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:43.569439 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:43.569403    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:31:43.820461 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:31:43.820433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:28.683960 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.683881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:28.823483 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.823443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:28.887821 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.887787    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:33:28.888151 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888137    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="feast-init"
Jun 11 21:33:28.888198 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888154    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="feast-init"
Jun 11 21:33:28.888198 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888162    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="feast-apply"
Jun 11 21:33:28.888198 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888167    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="feast-apply"
Jun 11 21:33:28.888198 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888189    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry"
Jun 11 21:33:28.888198 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888196    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888203    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61dcec6a-5f73-41a0-b236-a10b916822c8" containerName="redis"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888209    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61dcec6a-5f73-41a0-b236-a10b916822c8" containerName="redis"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888215    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="offline"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888220    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="offline"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888231    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888238    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888245    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bf5668-58ad-4217-be13-b306ca5916ba" containerName="postgres"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888286    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bf5668-58ad-4217-be13-b306ca5916ba" containerName="postgres"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888339    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38bf5668-58ad-4217-be13-b306ca5916ba" containerName="postgres"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888348    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="61dcec6a-5f73-41a0-b236-a10b916822c8" containerName="redis"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888355    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="offline"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888362    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="online"
Jun 11 21:33:28.888380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.888367    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4048b4c-0344-480a-bcf4-f89af1db42e0" containerName="registry"
Jun 11 21:33:28.891169 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.891152    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:33:28.894000 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.893979    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 11 21:33:28.894917 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.894890    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 11 21:33:28.894917 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.894890    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-2d8sr\""
Jun 11 21:33:28.905717 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.905677    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:33:28.916477 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:28.916451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:29.015334 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.015197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljx8\" (UniqueName: \"kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8\") pod \"redis-69bbd798b6-87grg\" (UID: \"ab5c6106-f206-4c9a-ac9e-e34f9615471b\") " pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:33:29.116627 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.116577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljx8\" (UniqueName: \"kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8\") pod \"redis-69bbd798b6-87grg\" (UID: \"ab5c6106-f206-4c9a-ac9e-e34f9615471b\") " pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:33:29.125167 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.125135    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljx8\" (UniqueName: \"kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8\") pod \"redis-69bbd798b6-87grg\" (UID: \"ab5c6106-f206-4c9a-ac9e-e34f9615471b\") " pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:33:29.211439 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.211396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:33:29.354084 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.353912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:33:29.356949 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:33:29.356923    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab5c6106_f206_4c9a_ac9e_e34f9615471b.slice/crio-0ebd8ad3104201d0c781634f866622cd76bdd5902a2bc9ffa5fb01702c4cdd11 WatchSource:0}: Error finding container 0ebd8ad3104201d0c781634f866622cd76bdd5902a2bc9ffa5fb01702c4cdd11: Status 404 returned error can't find the container with id 0ebd8ad3104201d0c781634f866622cd76bdd5902a2bc9ffa5fb01702c4cdd11
Jun 11 21:33:29.424075 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:29.424041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" event={"ID":"ab5c6106-f206-4c9a-ac9e-e34f9615471b","Type":"ContainerStarted","Data":"0ebd8ad3104201d0c781634f866622cd76bdd5902a2bc9ffa5fb01702c4cdd11"}
Jun 11 21:33:30.429502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:30.429464    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" event={"ID":"ab5c6106-f206-4c9a-ac9e-e34f9615471b","Type":"ContainerStarted","Data":"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"}
Jun 11 21:33:30.443438 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:30.443384    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" podStartSLOduration=2.443366071 podStartE2EDuration="2.443366071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:30.443008146 +0000 UTC m=+1095.023943273" watchObservedRunningTime="2026-06-11 21:33:30.443366071 +0000 UTC m=+1095.024301173"
Jun 11 21:33:34.305750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.305712    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:33:34.309592 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.309563    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.311807 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.311781    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 11 21:33:34.315334 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.315309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:33:34.342721 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.342690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:34.461014 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.460966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlkqd\" (UniqueName: \"kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.461202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.461047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.561993 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.561900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.561993 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.561953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlkqd\" (UniqueName: \"kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.562336 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.562317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.570087 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.570065    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlkqd\" (UniqueName: \"kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd\") pod \"postgres-864846d4f5-2w5f2\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") " pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.620963 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.620924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:33:34.762095 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:34.762061    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:33:34.765780 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:33:34.765751    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59a6d62d_b796_4e0e_b777_f4b16db46a57.slice/crio-35bffb08969f0cd6c52f2e9d8a04d9f860a5333173c8876e1a925ad4fe0fd882 WatchSource:0}: Error finding container 35bffb08969f0cd6c52f2e9d8a04d9f860a5333173c8876e1a925ad4fe0fd882: Status 404 returned error can't find the container with id 35bffb08969f0cd6c52f2e9d8a04d9f860a5333173c8876e1a925ad4fe0fd882
Jun 11 21:33:35.452024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:35.451983    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" event={"ID":"59a6d62d-b796-4e0e-b777-f4b16db46a57","Type":"ContainerStarted","Data":"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"}
Jun 11 21:33:35.452024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:35.452025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" event={"ID":"59a6d62d-b796-4e0e-b777-f4b16db46a57","Type":"ContainerStarted","Data":"35bffb08969f0cd6c52f2e9d8a04d9f860a5333173c8876e1a925ad4fe0fd882"}
Jun 11 21:33:35.470179 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:35.470125    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" podStartSLOduration=1.470110124 podStartE2EDuration="1.470110124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:35.469289904 +0000 UTC m=+1100.050225004" watchObservedRunningTime="2026-06-11 21:33:35.470110124 +0000 UTC m=+1100.051045224"
Jun 11 21:33:39.786093 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.786059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:39.854308 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.854268    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:39.862242 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.862205    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:33:39.866001 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.865979    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:39.868587 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.868561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 11 21:33:39.868587 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.868574    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 11 21:33:39.868819 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.868561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 11 21:33:39.868819 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.868767    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-kbczt\""
Jun 11 21:33:39.875845 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.875820    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:33:39.908721 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.908679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6cx\" (UniqueName: \"kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:39.908954 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.908734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:39.908954 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.908804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:39.908954 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:39.908847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.001793 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.001755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:40.009893 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.009853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6cx\" (UniqueName: \"kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.010059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.009907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.010059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.009941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.010059 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.009964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.010228 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:33:40.010092    2570 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jun 11 21:33:40.010228 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:33:40.010181    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls podName:2abcae12-acf0-43d8-a977-ebe93628d397 nodeName:}" failed. No retries permitted until 2026-06-11 21:33:40.510158727 +0000 UTC m=+1105.091093810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls") pod "feast-credit-scoring-9b5b4d5c-vvnfw" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397") : secret "feast-credit-scoring-online-tls" not found
Jun 11 21:33:40.010509 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.010487    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.012591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.012573    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.019242 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.019218    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6cx\" (UniqueName: \"kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.514140 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.514100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:40.514358 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:33:40.514220    2570 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jun 11 21:33:40.514358 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:33:40.514304    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls podName:2abcae12-acf0-43d8-a977-ebe93628d397 nodeName:}" failed. No retries permitted until 2026-06-11 21:33:41.51428865 +0000 UTC m=+1106.095223728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls") pod "feast-credit-scoring-9b5b4d5c-vvnfw" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397") : secret "feast-credit-scoring-online-tls" not found
Jun 11 21:33:40.604405 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:40.604368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:33:41.520683 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:41.520642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:41.523195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:41.523171    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-vvnfw\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:41.677439 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:41.677392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:41.818514 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:41.818485    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:33:41.821399 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:33:41.821363    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abcae12_acf0_43d8_a977_ebe93628d397.slice/crio-3912e56c0bddd26f59a9a00d09f15f6ba1ef3ab11772dc7ee498f359b511388d WatchSource:0}: Error finding container 3912e56c0bddd26f59a9a00d09f15f6ba1ef3ab11772dc7ee498f359b511388d: Status 404 returned error can't find the container with id 3912e56c0bddd26f59a9a00d09f15f6ba1ef3ab11772dc7ee498f359b511388d
Jun 11 21:33:42.483057 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:42.483018    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerStarted","Data":"2cb74afc787c3fbe7b0ad8de001b57de57cd0e0ddbb067cbed87df8164abb945"}
Jun 11 21:33:42.483280 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:42.483075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerStarted","Data":"3912e56c0bddd26f59a9a00d09f15f6ba1ef3ab11772dc7ee498f359b511388d"}
Jun 11 21:33:43.489338 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:43.489299    2570 generic.go:356] "Generic (PLEG): container finished" podID="2abcae12-acf0-43d8-a977-ebe93628d397" containerID="2cb74afc787c3fbe7b0ad8de001b57de57cd0e0ddbb067cbed87df8164abb945" exitCode=0
Jun 11 21:33:43.489338 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:43.489341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerDied","Data":"2cb74afc787c3fbe7b0ad8de001b57de57cd0e0ddbb067cbed87df8164abb945"}
Jun 11 21:33:44.496393 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:44.496360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerStarted","Data":"5d4ca81aeb52d5233d2df6c0fe19c85016670c6d587264a98e9304d31626f4ea"}
Jun 11 21:33:51.528689 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:51.528656    2570 generic.go:356] "Generic (PLEG): container finished" podID="2abcae12-acf0-43d8-a977-ebe93628d397" containerID="5d4ca81aeb52d5233d2df6c0fe19c85016670c6d587264a98e9304d31626f4ea" exitCode=0
Jun 11 21:33:51.529094 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:51.528732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerDied","Data":"5d4ca81aeb52d5233d2df6c0fe19c85016670c6d587264a98e9304d31626f4ea"}
Jun 11 21:33:52.535986 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:52.535937    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerStarted","Data":"7e72d16af5ae79c18ea049175d10f8472613c936398710449a6039ce682e244b"}
Jun 11 21:33:52.536386 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:52.536025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerStarted","Data":"844d240eb91aa0bd64dc99121ba1d703788c180f170d92f6856119eaab110e34"}
Jun 11 21:33:52.558708 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:52.558651    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podStartSLOduration=13.558633081 podStartE2EDuration="13.558633081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:52.555810949 +0000 UTC m=+1117.136746094" watchObservedRunningTime="2026-06-11 21:33:52.558633081 +0000 UTC m=+1117.139568182"
Jun 11 21:33:53.678595 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:53.678546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:53.679030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:53.678627    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:53.680459 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:53.680428    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 11 21:33:53.680584 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:53.680464    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 11 21:33:56.678116 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:56.678068    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 11 21:33:56.678560 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:56.678146    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 11 21:33:59.678222 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:59.678171    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 11 21:33:59.683591 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:59.683567    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:59.683997 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:59.683976    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:33:59.686869 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:33:59.686839    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:34:01.678223 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:01.678181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:34:02.057286 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:02.057177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:02.134475 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:02.134447    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:02.678488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:02.678439    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 11 21:34:05.679051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:05.679014    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:34:05.679702 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:05.679682    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:34:06.003177 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:06.003084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:10.748978 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.748938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:10.851940 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.851904    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:10.909034 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.909001    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:34:10.912887 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.912865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:10.915919 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.915898    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 11 21:34:10.916051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.915919    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-672rg\""
Jun 11 21:34:10.916051 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.915924    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 11 21:34:10.916190 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.915946    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 11 21:34:10.924073 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.924051    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:34:10.978209 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.978168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:10.978209 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.978209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:10.978527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.978405    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:10.978527 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.978456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x95b\" (UniqueName: \"kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:10.979160 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:10.979134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:11.079147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.079109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.079147 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.079155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x95b\" (UniqueName: \"kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.079464 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.079175    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.079464 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.079200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.079464 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:34:11.079325    2570 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Jun 11 21:34:11.079464 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:34:11.079406    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls podName:a4c49c3f-b246-46d7-8107-b8a240ed3cc0 nodeName:}" failed. No retries permitted until 2026-06-11 21:34:11.579384003 +0000 UTC m=+1136.160319097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls") pod "feast-driver-ranking-647c4f9bb-6wb9q" (UID: "a4c49c3f-b246-46d7-8107-b8a240ed3cc0") : secret "feast-driver-ranking-registry-tls" not found
Jun 11 21:34:11.079671 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.079582    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.081768 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.081742    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.087824 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.087798    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x95b\" (UniqueName: \"kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.186672 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.186632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:11.583729 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.583698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.586337 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.586305    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-6wb9q\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.823369 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.823325    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:11.964338 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:11.964311    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:34:11.966381 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:34:11.966351    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c49c3f_b246_46d7_8107_b8a240ed3cc0.slice/crio-34f27ffc096a4c1898005042aacd4aff6520e4d370de50ab215710720840f107 WatchSource:0}: Error finding container 34f27ffc096a4c1898005042aacd4aff6520e4d370de50ab215710720840f107: Status 404 returned error can't find the container with id 34f27ffc096a4c1898005042aacd4aff6520e4d370de50ab215710720840f107
Jun 11 21:34:12.631874 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:12.631834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerStarted","Data":"90a585626898d26ebf1e705590c4279876ddb37b668ad03f878e0edbf9cb6bbc"}
Jun 11 21:34:12.632077 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:12.631887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerStarted","Data":"34f27ffc096a4c1898005042aacd4aff6520e4d370de50ab215710720840f107"}
Jun 11 21:34:17.656975 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:17.656943    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerID="90a585626898d26ebf1e705590c4279876ddb37b668ad03f878e0edbf9cb6bbc" exitCode=0
Jun 11 21:34:17.657675 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:17.657015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerDied","Data":"90a585626898d26ebf1e705590c4279876ddb37b668ad03f878e0edbf9cb6bbc"}
Jun 11 21:34:18.663002 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:18.662961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerStarted","Data":"42fb39426f55946ed5d285633bada26a368f9c9f7d4af601ab24f8c36d73032a"}
Jun 11 21:34:23.802313 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:23.802281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:34:25.697377 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:25.697342    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerID="42fb39426f55946ed5d285633bada26a368f9c9f7d4af601ab24f8c36d73032a" exitCode=0
Jun 11 21:34:25.697751 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:25.697412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerDied","Data":"42fb39426f55946ed5d285633bada26a368f9c9f7d4af601ab24f8c36d73032a"}
Jun 11 21:34:25.700928 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:25.700903    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 11 21:34:26.704738 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.704704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerStarted","Data":"1ba0faf64d52f4c48f64c2d0de43917d7a21b09e81186c5565115baaaaaf6445"}
Jun 11 21:34:26.705113 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.704760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerStarted","Data":"bd243c8a0dae3127f44d65bdee1dc1a357c1575d569ad9d75793cf7a0fc19bbe"}
Jun 11 21:34:26.727074 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.727009    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podStartSLOduration=16.726986906 podStartE2EDuration="16.726986906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:34:26.725045417 +0000 UTC m=+1151.305980521" watchObservedRunningTime="2026-06-11 21:34:26.726986906 +0000 UTC m=+1151.307922010"
Jun 11 21:34:26.823637 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.823598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:26.823827 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.823677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:26.825467 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.825434    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 11 21:34:26.825636 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:26.825484    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 11 21:34:29.823670 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:29.823626    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 11 21:34:29.824160 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:29.823702    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 11 21:34:31.824132 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:31.824090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:31.824649 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:31.824179    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:32.823873 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:32.823778    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 11 21:34:32.829135 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:32.829093    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:33.744510 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:33.744477    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:35.824291 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:35.824225    2570 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 11 21:34:38.824337 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:38.824306    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:38.825074 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:38.825053    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:34:59.506359 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:34:59.506301    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:15.825201 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:15.825160    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:35:15.828889 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:15.828864    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:35:15.832854 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:15.832824    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:35:15.836330 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:15.836304    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:35:54.174049 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:54.174015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:56.484290 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:56.484236    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:56.779520 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:56.779436    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:35:56.779685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:56.779660    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" podUID="e13e7105-59a6-4d61-a858-aaed9874ed1a" containerName="manager" containerID="cri-o://71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f" gracePeriod=10
Jun 11 21:35:56.785875 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:56.785639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:56.992627 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:56.992549    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:57.030392 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.030202    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:35:57.031166 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.030863    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry" containerID="cri-o://844d240eb91aa0bd64dc99121ba1d703788c180f170d92f6856119eaab110e34" gracePeriod=30
Jun 11 21:35:57.031166 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.030941    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" containerID="cri-o://7e72d16af5ae79c18ea049175d10f8472613c936398710449a6039ce682e244b" gracePeriod=30
Jun 11 21:35:57.033119 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.032934    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:35:57.033418 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.033188    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry" containerID="cri-o://bd243c8a0dae3127f44d65bdee1dc1a357c1575d569ad9d75793cf7a0fc19bbe" gracePeriod=30
Jun 11 21:35:57.033418 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.033407    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" containerID="cri-o://1ba0faf64d52f4c48f64c2d0de43917d7a21b09e81186c5565115baaaaaf6445" gracePeriod=30
Jun 11 21:35:57.050426 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.050403    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:35:57.057015 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.056995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:57.117120 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.117080    2570 generic.go:356] "Generic (PLEG): container finished" podID="e13e7105-59a6-4d61-a858-aaed9874ed1a" containerID="71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f" exitCode=0
Jun 11 21:35:57.117322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.117130    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"
Jun 11 21:35:57.117322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.117159    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" event={"ID":"e13e7105-59a6-4d61-a858-aaed9874ed1a","Type":"ContainerDied","Data":"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"}
Jun 11 21:35:57.117322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.117214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv" event={"ID":"e13e7105-59a6-4d61-a858-aaed9874ed1a","Type":"ContainerDied","Data":"d20389c46a739db12e0f9d93b90da61ee98fb59d186b4082c98ab401dc97d8cc"}
Jun 11 21:35:57.117322 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.117236    2570 scope.go:117] "RemoveContainer" containerID="71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"
Jun 11 21:35:57.125839 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.125820    2570 scope.go:117] "RemoveContainer" containerID="71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"
Jun 11 21:35:57.126172 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:35:57.126154    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f\": container with ID starting with 71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f not found: ID does not exist" containerID="71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"
Jun 11 21:35:57.126299 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.126184    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f"} err="failed to get container status \"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f\": rpc error: code = NotFound desc = could not find container \"71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f\": container with ID starting with 71b26da40a0e54e6796db0ced80c138eeae078aa0f0433a8d3fbf55b4a5b643f not found: ID does not exist"
Jun 11 21:35:57.227153 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.227115    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-522wl\" (UniqueName: \"kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl\") pod \"e13e7105-59a6-4d61-a858-aaed9874ed1a\" (UID: \"e13e7105-59a6-4d61-a858-aaed9874ed1a\") "
Jun 11 21:35:57.230218 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.230187    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl" (OuterVolumeSpecName: "kube-api-access-522wl") pod "e13e7105-59a6-4d61-a858-aaed9874ed1a" (UID: "e13e7105-59a6-4d61-a858-aaed9874ed1a"). InnerVolumeSpecName "kube-api-access-522wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:35:57.328485 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.328451    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-522wl\" (UniqueName: \"kubernetes.io/projected/e13e7105-59a6-4d61-a858-aaed9874ed1a-kube-api-access-522wl\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:35:57.442855 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.442812    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:35:57.444560 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.444526    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cdcf57cb5-m2ksv"]
Jun 11 21:35:57.780903 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:57.780822    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13e7105-59a6-4d61-a858-aaed9874ed1a" path="/var/lib/kubelet/pods/e13e7105-59a6-4d61-a858-aaed9874ed1a/volumes"
Jun 11 21:35:58.124927 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:58.124885    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerID="1ba0faf64d52f4c48f64c2d0de43917d7a21b09e81186c5565115baaaaaf6445" exitCode=0
Jun 11 21:35:58.125117 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:58.124953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerDied","Data":"1ba0faf64d52f4c48f64c2d0de43917d7a21b09e81186c5565115baaaaaf6445"}
Jun 11 21:35:58.128496 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:58.128455    2570 generic.go:356] "Generic (PLEG): container finished" podID="2abcae12-acf0-43d8-a977-ebe93628d397" containerID="7e72d16af5ae79c18ea049175d10f8472613c936398710449a6039ce682e244b" exitCode=0
Jun 11 21:35:58.128656 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:58.128522    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerDied","Data":"7e72d16af5ae79c18ea049175d10f8472613c936398710449a6039ce682e244b"}
Jun 11 21:35:59.156153 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.156121    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:35:59.156672 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.156319    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" podUID="59a6d62d-b796-4e0e-b777-f4b16db46a57" containerName="postgres" containerID="cri-o://ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716" gracePeriod=30
Jun 11 21:35:59.163681 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.163116    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:35:59.163681 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.163337    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" podUID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" containerName="redis" containerID="cri-o://6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e" gracePeriod=30
Jun 11 21:35:59.213678 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.213637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:35:59.409930 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.409852    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:35:59.524202 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.524176    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:35:59.548547 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.548512    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlkqd\" (UniqueName: \"kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd\") pod \"59a6d62d-b796-4e0e-b777-f4b16db46a57\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") "
Jun 11 21:35:59.548726 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.548657    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata\") pod \"59a6d62d-b796-4e0e-b777-f4b16db46a57\" (UID: \"59a6d62d-b796-4e0e-b777-f4b16db46a57\") "
Jun 11 21:35:59.551207 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.551160    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd" (OuterVolumeSpecName: "kube-api-access-vlkqd") pod "59a6d62d-b796-4e0e-b777-f4b16db46a57" (UID: "59a6d62d-b796-4e0e-b777-f4b16db46a57"). InnerVolumeSpecName "kube-api-access-vlkqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:35:59.580716 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.580671    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "59a6d62d-b796-4e0e-b777-f4b16db46a57" (UID: "59a6d62d-b796-4e0e-b777-f4b16db46a57"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:35:59.650066 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.650032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qljx8\" (UniqueName: \"kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8\") pod \"ab5c6106-f206-4c9a-ac9e-e34f9615471b\" (UID: \"ab5c6106-f206-4c9a-ac9e-e34f9615471b\") "
Jun 11 21:35:59.650233 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.650182    2570 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/59a6d62d-b796-4e0e-b777-f4b16db46a57-postgresdata\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:35:59.650233 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.650194    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlkqd\" (UniqueName: \"kubernetes.io/projected/59a6d62d-b796-4e0e-b777-f4b16db46a57-kube-api-access-vlkqd\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:35:59.652320 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.652279    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8" (OuterVolumeSpecName: "kube-api-access-qljx8") pod "ab5c6106-f206-4c9a-ac9e-e34f9615471b" (UID: "ab5c6106-f206-4c9a-ac9e-e34f9615471b"). InnerVolumeSpecName "kube-api-access-qljx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:35:59.685060 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.684959    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 11 21:35:59.751638 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:35:59.751599    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qljx8\" (UniqueName: \"kubernetes.io/projected/ab5c6106-f206-4c9a-ac9e-e34f9615471b-kube-api-access-qljx8\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:00.138690 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.138657    2570 generic.go:356] "Generic (PLEG): container finished" podID="59a6d62d-b796-4e0e-b777-f4b16db46a57" containerID="ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716" exitCode=0
Jun 11 21:36:00.138878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.138702    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2"
Jun 11 21:36:00.138878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.138706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" event={"ID":"59a6d62d-b796-4e0e-b777-f4b16db46a57","Type":"ContainerDied","Data":"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"}
Jun 11 21:36:00.138878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.138758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-2w5f2" event={"ID":"59a6d62d-b796-4e0e-b777-f4b16db46a57","Type":"ContainerDied","Data":"35bffb08969f0cd6c52f2e9d8a04d9f860a5333173c8876e1a925ad4fe0fd882"}
Jun 11 21:36:00.138878 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.138782    2570 scope.go:117] "RemoveContainer" containerID="ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"
Jun 11 21:36:00.140091 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.140073    2570 generic.go:356] "Generic (PLEG): container finished" podID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" containerID="6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e" exitCode=0
Jun 11 21:36:00.140172 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.140105    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" event={"ID":"ab5c6106-f206-4c9a-ac9e-e34f9615471b","Type":"ContainerDied","Data":"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"}
Jun 11 21:36:00.140172 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.140138    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-87grg"
Jun 11 21:36:00.140172 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.140146    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-87grg" event={"ID":"ab5c6106-f206-4c9a-ac9e-e34f9615471b","Type":"ContainerDied","Data":"0ebd8ad3104201d0c781634f866622cd76bdd5902a2bc9ffa5fb01702c4cdd11"}
Jun 11 21:36:00.147872 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.147834    2570 scope.go:117] "RemoveContainer" containerID="ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"
Jun 11 21:36:00.148163 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:36:00.148144    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716\": container with ID starting with ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716 not found: ID does not exist" containerID="ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"
Jun 11 21:36:00.148220 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.148172    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716"} err="failed to get container status \"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716\": rpc error: code = NotFound desc = could not find container \"ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716\": container with ID starting with ef07f3ae2f522d76642ffaff80ad57ee8b8e425cc905e9497382668abb1c5716 not found: ID does not exist"
Jun 11 21:36:00.148220 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.148191    2570 scope.go:117] "RemoveContainer" containerID="6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"
Jun 11 21:36:00.156718 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.156696    2570 scope.go:117] "RemoveContainer" containerID="6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"
Jun 11 21:36:00.157080 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:36:00.157011    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e\": container with ID starting with 6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e not found: ID does not exist" containerID="6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"
Jun 11 21:36:00.157080 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.157037    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e"} err="failed to get container status \"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e\": rpc error: code = NotFound desc = could not find container \"6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e\": container with ID starting with 6e1a2b8e68a7ddb7270bda8c680f2632b0bab24e53a4ab454d1e9698a3e9552e not found: ID does not exist"
Jun 11 21:36:00.158156 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.158129    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:36:00.163185 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.163156    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-87grg"]
Jun 11 21:36:00.175053 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.175015    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:36:00.178876 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:00.178843    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-2w5f2"]
Jun 11 21:36:01.780561 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:01.780522    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a6d62d-b796-4e0e-b777-f4b16db46a57" path="/var/lib/kubelet/pods/59a6d62d-b796-4e0e-b777-f4b16db46a57/volumes"
Jun 11 21:36:01.780950 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:01.780853    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" path="/var/lib/kubelet/pods/ab5c6106-f206-4c9a-ac9e-e34f9615471b/volumes"
Jun 11 21:36:02.010750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:02.010682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:03.182530 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:03.182392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:03.741713 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:03.741671    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 11 21:36:07.876009 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:07.875968    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:07.969083 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:07.969042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:08.297762 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:08.297640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:09.684736 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:09.684683    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 11 21:36:13.741798 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:13.741750    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 11 21:36:15.873086 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:15.873046    2570 scope.go:117] "RemoveContainer" containerID="0e2a9a5ec5d0d2e15e810bf5956050c00c40075073297f533a9d61f4c5c4ae49"
Jun 11 21:36:19.685282 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:19.685213    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 11 21:36:19.685755 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:19.685370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:36:23.742087 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:23.742036    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 11 21:36:23.742519 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:23.742211    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:36:24.527417 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:24.527381    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:24.628684 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:24.628651    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:24.898765 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:24.898722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:24.988805 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:24.988764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:25.055863 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:25.055829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:25.149488 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:25.149387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:25.249871 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:25.249838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:25.576578 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:25.576547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:27.255372 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.255342    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerID="bd243c8a0dae3127f44d65bdee1dc1a357c1575d569ad9d75793cf7a0fc19bbe" exitCode=137
Jun 11 21:36:27.255781 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.255410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerDied","Data":"bd243c8a0dae3127f44d65bdee1dc1a357c1575d569ad9d75793cf7a0fc19bbe"}
Jun 11 21:36:27.257674 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.257648    2570 generic.go:356] "Generic (PLEG): container finished" podID="2abcae12-acf0-43d8-a977-ebe93628d397" containerID="844d240eb91aa0bd64dc99121ba1d703788c180f170d92f6856119eaab110e34" exitCode=137
Jun 11 21:36:27.257790 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.257719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerDied","Data":"844d240eb91aa0bd64dc99121ba1d703788c180f170d92f6856119eaab110e34"}
Jun 11 21:36:27.717216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.717190    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:36:27.720143 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.720119    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:36:27.795895 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.795859    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls\") pod \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.795911    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") pod \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.795947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data\") pod \"2abcae12-acf0-43d8-a977-ebe93628d397\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.795976    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls\") pod \"2abcae12-acf0-43d8-a977-ebe93628d397\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.796017    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd6cx\" (UniqueName: \"kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx\") pod \"2abcae12-acf0-43d8-a977-ebe93628d397\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.796076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") pod \"2abcae12-acf0-43d8-a977-ebe93628d397\" (UID: \"2abcae12-acf0-43d8-a977-ebe93628d397\") "
Jun 11 21:36:27.796102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.796100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x95b\" (UniqueName: \"kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b\") pod \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") "
Jun 11 21:36:27.796526 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.796137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data\") pod \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\" (UID: \"a4c49c3f-b246-46d7-8107-b8a240ed3cc0\") "
Jun 11 21:36:27.797080 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.797046    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data" (OuterVolumeSpecName: "feast-data") pod "a4c49c3f-b246-46d7-8107-b8a240ed3cc0" (UID: "a4c49c3f-b246-46d7-8107-b8a240ed3cc0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:36:27.797578 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.797514    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.799162 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.799097    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a4c49c3f-b246-46d7-8107-b8a240ed3cc0" (UID: "a4c49c3f-b246-46d7-8107-b8a240ed3cc0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:36:27.799545 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.799511    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls" (OuterVolumeSpecName: "online-tls") pod "a4c49c3f-b246-46d7-8107-b8a240ed3cc0" (UID: "a4c49c3f-b246-46d7-8107-b8a240ed3cc0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:36:27.799621 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.799543    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx" (OuterVolumeSpecName: "kube-api-access-sd6cx") pod "2abcae12-acf0-43d8-a977-ebe93628d397" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397"). InnerVolumeSpecName "kube-api-access-sd6cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:36:27.799621 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.799561    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2abcae12-acf0-43d8-a977-ebe93628d397" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:36:27.799812 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.799789    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b" (OuterVolumeSpecName: "kube-api-access-9x95b") pod "a4c49c3f-b246-46d7-8107-b8a240ed3cc0" (UID: "a4c49c3f-b246-46d7-8107-b8a240ed3cc0"). InnerVolumeSpecName "kube-api-access-9x95b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:36:27.800408 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.800387    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls" (OuterVolumeSpecName: "online-tls") pod "2abcae12-acf0-43d8-a977-ebe93628d397" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 21:36:27.807412 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.807370    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data" (OuterVolumeSpecName: "feast-data") pod "2abcae12-acf0-43d8-a977-ebe93628d397" (UID: "2abcae12-acf0-43d8-a977-ebe93628d397"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:36:27.898967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.898931    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.898967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.898963    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.898967 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.898972    2570 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2abcae12-acf0-43d8-a977-ebe93628d397-feast-data\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.899216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.898981    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-registry-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.899216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.898992    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd6cx\" (UniqueName: \"kubernetes.io/projected/2abcae12-acf0-43d8-a977-ebe93628d397-kube-api-access-sd6cx\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.899216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.899001    2570 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2abcae12-acf0-43d8-a977-ebe93628d397-online-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:27.899216 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:27.899009    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x95b\" (UniqueName: \"kubernetes.io/projected/a4c49c3f-b246-46d7-8107-b8a240ed3cc0-kube-api-access-9x95b\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:36:28.264585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.264559    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"
Jun 11 21:36:28.264585 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.264559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q" event={"ID":"a4c49c3f-b246-46d7-8107-b8a240ed3cc0","Type":"ContainerDied","Data":"34f27ffc096a4c1898005042aacd4aff6520e4d370de50ab215710720840f107"}
Jun 11 21:36:28.265103 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.264628    2570 scope.go:117] "RemoveContainer" containerID="1ba0faf64d52f4c48f64c2d0de43917d7a21b09e81186c5565115baaaaaf6445"
Jun 11 21:36:28.267029 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.267003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw" event={"ID":"2abcae12-acf0-43d8-a977-ebe93628d397","Type":"ContainerDied","Data":"3912e56c0bddd26f59a9a00d09f15f6ba1ef3ab11772dc7ee498f359b511388d"}
Jun 11 21:36:28.267148 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.267054    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"
Jun 11 21:36:28.282032 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.282014    2570 scope.go:117] "RemoveContainer" containerID="bd243c8a0dae3127f44d65bdee1dc1a357c1575d569ad9d75793cf7a0fc19bbe"
Jun 11 21:36:28.291196 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.291174    2570 scope.go:117] "RemoveContainer" containerID="42fb39426f55946ed5d285633bada26a368f9c9f7d4af601ab24f8c36d73032a"
Jun 11 21:36:28.291637 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.291617    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:36:28.295785 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.295755    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-6wb9q"]
Jun 11 21:36:28.300750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.300733    2570 scope.go:117] "RemoveContainer" containerID="90a585626898d26ebf1e705590c4279876ddb37b668ad03f878e0edbf9cb6bbc"
Jun 11 21:36:28.306371 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.306345    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:36:28.309991 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.309973    2570 scope.go:117] "RemoveContainer" containerID="7e72d16af5ae79c18ea049175d10f8472613c936398710449a6039ce682e244b"
Jun 11 21:36:28.310389 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.310246    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-vvnfw"]
Jun 11 21:36:28.318131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.318109    2570 scope.go:117] "RemoveContainer" containerID="844d240eb91aa0bd64dc99121ba1d703788c180f170d92f6856119eaab110e34"
Jun 11 21:36:28.326329 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.326309    2570 scope.go:117] "RemoveContainer" containerID="5d4ca81aeb52d5233d2df6c0fe19c85016670c6d587264a98e9304d31626f4ea"
Jun 11 21:36:28.334339 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:28.334293    2570 scope.go:117] "RemoveContainer" containerID="2cb74afc787c3fbe7b0ad8de001b57de57cd0e0ddbb067cbed87df8164abb945"
Jun 11 21:36:29.780605 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:29.780569    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" path="/var/lib/kubelet/pods/2abcae12-acf0-43d8-a977-ebe93628d397/volumes"
Jun 11 21:36:29.781060 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:29.781046    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" path="/var/lib/kubelet/pods/a4c49c3f-b246-46d7-8107-b8a240ed3cc0/volumes"
Jun 11 21:36:36.769818 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:36.769784    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:36.827602 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:36.827569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:36:37.025962 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:36:37.025868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:37:33.925525 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:37:33.925438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.347804 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.347773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.447709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.447676    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.547539 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.547503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.648143 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.648048    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.728791 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.728758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.794767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.794726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:02.883150 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:02.883117    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:38:03.013417 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:38:03.013322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:39:24.621498 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:39:24.621407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:39:24.722030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:39:24.721994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:39:24.822582 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:39:24.822547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:15.856869 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:15.856840    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:40:15.859807 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:15.859780    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:40:15.863229 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:15.863207    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:40:15.866122 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:15.866101    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:40:20.043689 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:20.043614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:20.092982 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:20.092950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:25.894567 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:25.894524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:36.589854 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:36.589814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:45.705769 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:45.705723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:45.763502 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:45.763467    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:45.860998 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:45.860965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:45.913871 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:45.913839    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:45.968638 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:45.968551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:40:51.036773 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:40:51.036744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:28.710900 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:28.710863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:30.139107 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:30.139074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:34.342588 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:34.342554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:34.443066 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:34.443031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:53.172034 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:53.171988    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:53.273192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:53.273154    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:58.076037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:58.075995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:58.156213 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:58.156169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:58.221038 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:58.220994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:58.386086 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:58.386005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:41:58.487405 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:41:58.487374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:42:44.834043 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:42:44.834008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:42:44.885832 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:42:44.885793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.127071 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.127041    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.182495 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.182457    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.316022 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.315976    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.400917 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.400789    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.621402 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.621351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.721911 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.721818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:19.987930 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:19.987844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:46.913382 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:46.913347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:43:46.967714 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:43:46.967681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.461160 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.461127    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.563292 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.563232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.703116 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.703084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.802945 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.802837    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.874817 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.874779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:40.936032 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:40.935995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:44:41.125997 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:44:41.125967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:45:15.882456 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:45:15.882425    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:45:15.885301 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:45:15.885279    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:45:15.889663 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:45:15.889636    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:45:15.892341 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:45:15.892319    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:46:01.882058 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:01.882020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:01.944690 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:01.944653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:02.047728 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:02.047696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:02.122976 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:02.122945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:02.191494 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:02.191405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:07.209309 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:07.209250    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:44.800425 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:44.800388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:46.105830 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:46.105799    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:50.441430 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:50.441396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:50.502553 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:50.502525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:51.465214 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465178    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-54b5z/must-gather-hgnss"]
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465517    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465528    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465537    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465542    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465550    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465556    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465566    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="feast-apply"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465571    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="feast-apply"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465576    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="feast-apply"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465582    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="feast-apply"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465598    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" containerName="redis"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465602    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" containerName="redis"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465608    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a6d62d-b796-4e0e-b777-f4b16db46a57" containerName="postgres"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465613    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a6d62d-b796-4e0e-b777-f4b16db46a57" containerName="postgres"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465619    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13e7105-59a6-4d61-a858-aaed9874ed1a" containerName="manager"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465628    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13e7105-59a6-4d61-a858-aaed9874ed1a" containerName="manager"
Jun 11 21:46:51.465625 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465634    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="feast-init"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465639    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="feast-init"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465644    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465649    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465655    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="feast-init"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465660    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="feast-init"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465711    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="online"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465718    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab5c6106-f206-4c9a-ac9e-e34f9615471b" containerName="redis"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465724    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13e7105-59a6-4d61-a858-aaed9874ed1a" containerName="manager"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465730    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a6d62d-b796-4e0e-b777-f4b16db46a57" containerName="postgres"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465736    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="registry"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465742    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abcae12-acf0-43d8-a977-ebe93628d397" containerName="registry"
Jun 11 21:46:51.466131 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.465749    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c49c3f-b246-46d7-8107-b8a240ed3cc0" containerName="online"
Jun 11 21:46:51.468772 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.468748    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.471393 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.471373    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54b5z\"/\"openshift-service-ca.crt\""
Jun 11 21:46:51.472380 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.472363    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-54b5z\"/\"default-dockercfg-r5mp4\""
Jun 11 21:46:51.472476 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.472367    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54b5z\"/\"kube-root-ca.crt\""
Jun 11 21:46:51.477024 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.476999    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54b5z/must-gather-hgnss"]
Jun 11 21:46:51.478043 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.478022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:51.574995 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.574960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:46:51.583631 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.583602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxpzb\" (UniqueName: \"kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.583810 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.583656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.684453 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.684409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.684657 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.684513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxpzb\" (UniqueName: \"kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.684769 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.684747    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.692960 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.692933    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxpzb\" (UniqueName: \"kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb\") pod \"must-gather-hgnss\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") " pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.792784 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.792684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:46:51.924714 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.924673    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54b5z/must-gather-hgnss"]
Jun 11 21:46:51.927653 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:46:51.927623    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode42f7d0b_845b_4e0a_bb54_a5b7a6598fbe.slice/crio-a0dad621ac576fd22d5d91d2741a530197c029617a842564a278fbf46ea5563b WatchSource:0}: Error finding container a0dad621ac576fd22d5d91d2741a530197c029617a842564a278fbf46ea5563b: Status 404 returned error can't find the container with id a0dad621ac576fd22d5d91d2741a530197c029617a842564a278fbf46ea5563b
Jun 11 21:46:51.929357 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:51.929339    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 21:46:52.740523 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:52.740479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54b5z/must-gather-hgnss" event={"ID":"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe","Type":"ContainerStarted","Data":"a0dad621ac576fd22d5d91d2741a530197c029617a842564a278fbf46ea5563b"}
Jun 11 21:46:58.769102 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:58.769054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54b5z/must-gather-hgnss" event={"ID":"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe","Type":"ContainerStarted","Data":"da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a"}
Jun 11 21:46:58.769572 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:58.769108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54b5z/must-gather-hgnss" event={"ID":"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe","Type":"ContainerStarted","Data":"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"}
Jun 11 21:46:58.814365 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:46:58.814296    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-54b5z/must-gather-hgnss" podStartSLOduration=1.822350808 podStartE2EDuration="7.814279109s" totalImagesPullingTime="5.991928301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:58.814180617 +0000 UTC m=+1903.395115732" watchObservedRunningTime="2026-06-11 21:46:58.814279109 +0000 UTC m=+1903.395214203"
Jun 11 21:47:08.809903 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:08.809867    2570 generic.go:356] "Generic (PLEG): container finished" podID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerID="0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509" exitCode=0
Jun 11 21:47:08.810374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:08.809942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54b5z/must-gather-hgnss" event={"ID":"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe","Type":"ContainerDied","Data":"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"}
Jun 11 21:47:08.810374 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:08.810244    2570 scope.go:117] "RemoveContainer" containerID="0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"
Jun 11 21:47:08.853645 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:08.853615    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-54b5z_must-gather-hgnss_e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe/gather/0.log"
Jun 11 21:47:09.210835 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.210802    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:47:09.353867 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.353830    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knwbb/must-gather-zwtc7"]
Jun 11 21:47:09.357083 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.357063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.359734 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.359709    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knwbb\"/\"openshift-service-ca.crt\""
Jun 11 21:47:09.359734 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.359727    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knwbb\"/\"kube-root-ca.crt\""
Jun 11 21:47:09.359903 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.359809    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-knwbb\"/\"default-dockercfg-ws4gd\""
Jun 11 21:47:09.364719 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.364693    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knwbb/must-gather-zwtc7"]
Jun 11 21:47:09.367686 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.367662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:47:09.448142 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.448101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5sc\" (UniqueName: \"kubernetes.io/projected/3907af0b-36e7-4ed0-849e-8c83a64c3b70-kube-api-access-8d5sc\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.448375 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.448184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3907af0b-36e7-4ed0-849e-8c83a64c3b70-must-gather-output\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.465877 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.465801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:47:09.548717 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.548669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5sc\" (UniqueName: \"kubernetes.io/projected/3907af0b-36e7-4ed0-849e-8c83a64c3b70-kube-api-access-8d5sc\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.548901 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.548747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3907af0b-36e7-4ed0-849e-8c83a64c3b70-must-gather-output\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.549138 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.549116    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3907af0b-36e7-4ed0-849e-8c83a64c3b70-must-gather-output\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.556886 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.556850    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5sc\" (UniqueName: \"kubernetes.io/projected/3907af0b-36e7-4ed0-849e-8c83a64c3b70-kube-api-access-8d5sc\") pod \"must-gather-zwtc7\" (UID: \"3907af0b-36e7-4ed0-849e-8c83a64c3b70\") " pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.666508 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.666469    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knwbb/must-gather-zwtc7"
Jun 11 21:47:09.805681 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.805570    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knwbb/must-gather-zwtc7"]
Jun 11 21:47:09.808385 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:47:09.808357    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3907af0b_36e7_4ed0_849e_8c83a64c3b70.slice/crio-eaa005eaed026c768b2ea55da788fe8acd6833f5717aa6faf1cbb8b190e42f77 WatchSource:0}: Error finding container eaa005eaed026c768b2ea55da788fe8acd6833f5717aa6faf1cbb8b190e42f77: Status 404 returned error can't find the container with id eaa005eaed026c768b2ea55da788fe8acd6833f5717aa6faf1cbb8b190e42f77
Jun 11 21:47:09.815343 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:09.815312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knwbb/must-gather-zwtc7" event={"ID":"3907af0b-36e7-4ed0-849e-8c83a64c3b70","Type":"ContainerStarted","Data":"eaa005eaed026c768b2ea55da788fe8acd6833f5717aa6faf1cbb8b190e42f77"}
Jun 11 21:47:10.821560 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:10.821527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knwbb/must-gather-zwtc7" event={"ID":"3907af0b-36e7-4ed0-849e-8c83a64c3b70","Type":"ContainerStarted","Data":"4fd6e4311a67986679a2e7cb1a7eace58b68333b47e6be098ec252957d7fb580"}
Jun 11 21:47:10.821919 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:10.821578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knwbb/must-gather-zwtc7" event={"ID":"3907af0b-36e7-4ed0-849e-8c83a64c3b70","Type":"ContainerStarted","Data":"a2506b4bd2358ec485d06418092f2631432f0db26feab3c1ddb53ee20408ae3d"}
Jun 11 21:47:10.839566 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:10.839409    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-knwbb/must-gather-zwtc7" podStartSLOduration=1.05478711 podStartE2EDuration="1.839387998s" totalImagesPullingTime="784.600888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:10.839155684 +0000 UTC m=+1915.420090822" watchObservedRunningTime="2026-06-11 21:47:10.839387998 +0000 UTC m=+1915.420323100"
Jun 11 21:47:12.037201 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:12.037166    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l5m7k_10907c69-8e2f-49a6-bf6f-16a0a340b680/global-pull-secret-syncer/0.log"
Jun 11 21:47:12.092360 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:12.092320    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log"
Jun 11 21:47:12.176984 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:12.176945    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-9.ec2.internal_7fef89a041c43606001c87b66f83a9e8/haproxy/0.log"
Jun 11 21:47:14.188213 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.188167    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-54b5z/must-gather-hgnss"]
Jun 11 21:47:14.188701 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.188446    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-54b5z/must-gather-hgnss" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="copy" containerID="cri-o://da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a" gracePeriod=2
Jun 11 21:47:14.192015 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.191983    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-54b5z/must-gather-hgnss"]
Jun 11 21:47:14.192270 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.192221    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hgnss\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-54b5z\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.603825 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.603780    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-54b5z_must-gather-hgnss_e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe/copy/0.log"
Jun 11 21:47:14.609291 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.608743    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.613281 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.611211    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hgnss\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-54b5z\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.658448 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.658410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:47:14.711319 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.711187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2kvgc_4759d092-5db8-40fe-9f65-32a08a01e89c/konnectivity-agent/0.log" limit=1024
Jun 11 21:47:14.801037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.800267    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output\") pod \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") "
Jun 11 21:47:14.801037 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.800388    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxpzb\" (UniqueName: \"kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb\") pod \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\" (UID: \"e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe\") "
Jun 11 21:47:14.801956 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.801919    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" (UID: "e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 21:47:14.809739 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.809694    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb" (OuterVolumeSpecName: "kube-api-access-qxpzb") pod "e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" (UID: "e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe"). InnerVolumeSpecName "kube-api-access-qxpzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 21:47:14.845188 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.845148    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-54b5z_must-gather-hgnss_e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe/copy/0.log"
Jun 11 21:47:14.845662 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.845634    2570 generic.go:356] "Generic (PLEG): container finished" podID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerID="da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a" exitCode=143
Jun 11 21:47:14.845754 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.845706    2570 scope.go:117] "RemoveContainer" containerID="da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a"
Jun 11 21:47:14.845905 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.845886    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.857377 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.857153    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hgnss\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-54b5z\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.860291 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.860214    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hgnss\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-54b5z\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:14.869420 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.869138    2570 scope.go:117] "RemoveContainer" containerID="0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"
Jun 11 21:47:14.890786 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.890756    2570 scope.go:117] "RemoveContainer" containerID="da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a"
Jun 11 21:47:14.891318 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.891284    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a\": container with ID starting with da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a not found: ID does not exist" containerID="da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a"
Jun 11 21:47:14.891443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.891331    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a"} err="failed to get container status \"da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a\": rpc error: code = NotFound desc = could not find container \"da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a\": container with ID starting with da9a04c3c4edd9652050333ea01e6816c1acba3397d1424b9848eb3a7e4d1c2a not found: ID does not exist"
Jun 11 21:47:14.891443 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.891355    2570 scope.go:117] "RemoveContainer" containerID="0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"
Jun 11 21:47:14.891741 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:14.891714    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509\": container with ID starting with 0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509 not found: ID does not exist" containerID="0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"
Jun 11 21:47:14.891846 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.891750    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509"} err="failed to get container status \"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509\": rpc error: code = NotFound desc = could not find container \"0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509\": container with ID starting with 0fc05b8f5cbb8c973a162568d86d8ca2f53a10bfd8407dcf36c1663efe839509 not found: ID does not exist"
Jun 11 21:47:14.901408 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.901374    2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-must-gather-output\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:47:14.901408 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:14.901408    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxpzb\" (UniqueName: \"kubernetes.io/projected/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe-kube-api-access-qxpzb\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\""
Jun 11 21:47:15.780924 ip-10-0-133-9 kubenswrapper[2570]: E0611 21:47:15.780771    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hgnss\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-54b5z\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" pod="openshift-must-gather-54b5z/must-gather-hgnss"
Jun 11 21:47:15.784186 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:15.783719    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" path="/var/lib/kubelet/pods/e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe/volumes"
Jun 11 21:47:16.197726 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.197678    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7zczq_9b6add45-f669-49bf-a3bc-114ac7c66305/kube-state-metrics/0.log"
Jun 11 21:47:16.218950 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.218924    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7zczq_9b6add45-f669-49bf-a3bc-114ac7c66305/kube-rbac-proxy-main/0.log"
Jun 11 21:47:16.242384 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.242358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-7zczq_9b6add45-f669-49bf-a3bc-114ac7c66305/kube-rbac-proxy-self/0.log"
Jun 11 21:47:16.352898 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.352863    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qjqs_e9659a11-3a70-48c3-8770-0c639b434b34/node-exporter/0.log"
Jun 11 21:47:16.378767 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.378727    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qjqs_e9659a11-3a70-48c3-8770-0c639b434b34/kube-rbac-proxy/0.log"
Jun 11 21:47:16.401709 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.401674    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9qjqs_e9659a11-3a70-48c3-8770-0c639b434b34/init-textfile/0.log"
Jun 11 21:47:16.605179 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.605137    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kkfs7_2709c530-9560-4c31-b66a-368e870b7e6b/kube-rbac-proxy-main/0.log"
Jun 11 21:47:16.629398 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.629368    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kkfs7_2709c530-9560-4c31-b66a-368e870b7e6b/kube-rbac-proxy-self/0.log"
Jun 11 21:47:16.652955 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.652917    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-kkfs7_2709c530-9560-4c31-b66a-368e870b7e6b/openshift-state-metrics/0.log"
Jun 11 21:47:16.952732 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.952492    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5858cf8-kdlzw_5998a009-c582-474e-8f00-851268321d11/telemeter-client/0.log"
Jun 11 21:47:16.975210 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.975178    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5858cf8-kdlzw_5998a009-c582-474e-8f00-851268321d11/reload/0.log"
Jun 11 21:47:16.999522 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:16.999482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8f5858cf8-kdlzw_5998a009-c582-474e-8f00-851268321d11/kube-rbac-proxy/0.log"
Jun 11 21:47:17.031869 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.031816    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/thanos-query/0.log"
Jun 11 21:47:17.058238 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.058205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/kube-rbac-proxy-web/0.log"
Jun 11 21:47:17.084843 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.084811    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/kube-rbac-proxy/0.log"
Jun 11 21:47:17.111563 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.111532    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/prom-label-proxy/0.log"
Jun 11 21:47:17.142390 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.142327    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/kube-rbac-proxy-rules/0.log"
Jun 11 21:47:17.167964 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:17.167928    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9cf98b76f-gzmql_90bc2019-ace1-475f-8898-2b6f1366e26b/kube-rbac-proxy-metrics/0.log"
Jun 11 21:47:18.455932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:18.455845    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-gnppz_ac169553-1997-44de-a37a-f5240da6e15b/networking-console-plugin/0.log"
Jun 11 21:47:18.901454 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:18.901424    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/1.log"
Jun 11 21:47:18.908692 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:18.908646    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kpjnk_3a0fc190-2032-450c-a96e-efe658efe690/console-operator/2.log"
Jun 11 21:47:19.315665 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.315590    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-fd89d_2e69a670-32cc-4a0e-9a41-ffd98e66c37e/download-server/0.log"
Jun 11 21:47:19.570161 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570124    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"]
Jun 11 21:47:19.570613 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570596    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="gather"
Jun 11 21:47:19.570679 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570616    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="gather"
Jun 11 21:47:19.570679 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570624    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="copy"
Jun 11 21:47:19.570679 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570629    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="copy"
Jun 11 21:47:19.570783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570686    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="copy"
Jun 11 21:47:19.570783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.570697    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42f7d0b-845b-4e0a-bb54-a5b7a6598fbe" containerName="gather"
Jun 11 21:47:19.575685 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.575650    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.587643 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.587156    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"]
Jun 11 21:47:19.646777 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.646740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-podres\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.646777 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.646782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-sys\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.647030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.646853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k59b8\" (UniqueName: \"kubernetes.io/projected/c44ffdd6-c58b-4b96-9bd4-68a759854352-kube-api-access-k59b8\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.647030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.646911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-proc\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.647030 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.646957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-lib-modules\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748347 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-podres\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748783 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-sys\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748690    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-podres\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748848    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-sys\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k59b8\" (UniqueName: \"kubernetes.io/projected/c44ffdd6-c58b-4b96-9bd4-68a759854352-kube-api-access-k59b8\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.748912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-proc\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.749114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.748949    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-lib-modules\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.749114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.749013    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-proc\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.749114 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.749056    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44ffdd6-c58b-4b96-9bd4-68a759854352-lib-modules\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.758164 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.758130    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k59b8\" (UniqueName: \"kubernetes.io/projected/c44ffdd6-c58b-4b96-9bd4-68a759854352-kube-api-access-k59b8\") pod \"perf-node-gather-daemonset-8dtxq\" (UID: \"c44ffdd6-c58b-4b96-9bd4-68a759854352\") " pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:19.892368 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:19.892276    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:20.064407 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.063886    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"]
Jun 11 21:47:20.069582 ip-10-0-133-9 kubenswrapper[2570]: W0611 21:47:20.069516    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc44ffdd6_c58b_4b96_9bd4_68a759854352.slice/crio-3c4de97858f54971a4e240ec50150c9db743f847b4e4b91f2551e8a6c8f18cc5 WatchSource:0}: Error finding container 3c4de97858f54971a4e240ec50150c9db743f847b4e4b91f2551e8a6c8f18cc5: Status 404 returned error can't find the container with id 3c4de97858f54971a4e240ec50150c9db743f847b4e4b91f2551e8a6c8f18cc5
Jun 11 21:47:20.651932 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.651900    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt4g2_cb1995ac-e412-4f9c-8a33-4fd624133161/dns/0.log"
Jun 11 21:47:20.676441 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.676399    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nt4g2_cb1995ac-e412-4f9c-8a33-4fd624133161/kube-rbac-proxy/0.log"
Jun 11 21:47:20.805040 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.805008    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-489ln_e06bc113-442c-42db-9db3-3ea0fa6ce504/dns-node-resolver/0.log"
Jun 11 21:47:20.882119 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.882082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq" event={"ID":"c44ffdd6-c58b-4b96-9bd4-68a759854352","Type":"ContainerStarted","Data":"b071a4dfb0cd5b8e1490d4ad5e7092b2f93fc6e2942202ab784cd3fb19e47041"}
Jun 11 21:47:20.882434 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.882396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq" event={"ID":"c44ffdd6-c58b-4b96-9bd4-68a759854352","Type":"ContainerStarted","Data":"3c4de97858f54971a4e240ec50150c9db743f847b4e4b91f2551e8a6c8f18cc5"}
Jun 11 21:47:20.882573 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.882446    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:20.898748 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:20.898682    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq" podStartSLOduration=1.898661142 podStartE2EDuration="1.898661142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:20.897860919 +0000 UTC m=+1925.478796070" watchObservedRunningTime="2026-06-11 21:47:20.898661142 +0000 UTC m=+1925.479596245"
Jun 11 21:47:21.252717 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:21.252691    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-57b5h_fa2d51f9-0c0d-47df-ac04-a4f0cc73eaa9/node-ca/0.log"
Jun 11 21:47:22.341567 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.341538    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c4t7g_c1ae5a40-0556-435a-a739-e04b9a6b3cf0/serve-healthcheck-canary/0.log"
Jun 11 21:47:22.714342 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.714231    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-fp442_6739aa17-7177-4536-b99e-7fca6ddd80c3/insights-operator/0.log"
Jun 11 21:47:22.714759 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.714730    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-fp442_6739aa17-7177-4536-b99e-7fca6ddd80c3/insights-operator/1.log"
Jun 11 21:47:22.737383 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.737351    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9gtd_1e83b37c-9afe-414f-a350-ef929353f64b/kube-rbac-proxy/0.log"
Jun 11 21:47:22.759195 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.759164    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9gtd_1e83b37c-9afe-414f-a350-ef929353f64b/exporter/0.log"
Jun 11 21:47:22.781772 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:22.781743    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9gtd_1e83b37c-9afe-414f-a350-ef929353f64b/extractor/0.log"
Jun 11 21:47:26.902962 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:26.902101    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-knwbb/perf-node-gather-daemonset-8dtxq"
Jun 11 21:47:26.945912 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:26.945881    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-5sxqx_9840eb29-6cd3-4cd6-8f95-8bffd672a9ce/migrator/0.log"
Jun 11 21:47:26.966070 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:26.966038    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-5sxqx_9840eb29-6cd3-4cd6-8f95-8bffd672a9ce/graceful-termination/0.log"
Jun 11 21:47:28.199241 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.199206    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9tftw_3fb7a572-2bd0-412f-8ac0-c1a6e615f5e9/kube-multus/0.log"
Jun 11 21:47:28.226507 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.226354    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/kube-multus-additional-cni-plugins/0.log"
Jun 11 21:47:28.249056 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.249026    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/egress-router-binary-copy/0.log"
Jun 11 21:47:28.271971 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.271945    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/cni-plugins/0.log"
Jun 11 21:47:28.293755 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.293719    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/bond-cni-plugin/0.log"
Jun 11 21:47:28.317539 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.317507    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/routeoverride-cni/0.log"
Jun 11 21:47:28.341026 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.340998    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/whereabouts-cni-bincopy/0.log"
Jun 11 21:47:28.362328 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.362301    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4l7q8_1659540e-4667-4024-886d-2536e3097f09/whereabouts-cni/0.log"
Jun 11 21:47:28.869724 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.869688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mhf2x_1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c/network-metrics-daemon/0.log"
Jun 11 21:47:28.890656 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:28.890625    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mhf2x_1ae9a1bb-3bf6-40fd-8d0b-044e0b7e998c/kube-rbac-proxy/0.log"
Jun 11 21:47:29.658750 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.658666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-controller/0.log"
Jun 11 21:47:29.680006 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.679974    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/1.log"
Jun 11 21:47:29.680192 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.680028    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovn-acl-logging/0.log"
Jun 11 21:47:29.702958 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.702914    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/kube-rbac-proxy-node/0.log"
Jun 11 21:47:29.723646 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.723619    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/kube-rbac-proxy-ovn-metrics/0.log"
Jun 11 21:47:29.742158 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.742111    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/northd/0.log"
Jun 11 21:47:29.763947 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.763922    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/nbdb/0.log"
Jun 11 21:47:29.785632 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.785588    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/sbdb/0.log"
Jun 11 21:47:29.833137 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:29.833109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6gdgq_ae4f0792-6d63-4b81-9cf7-3e1537559f30/ovnkube-controller/0.log"
Jun 11 21:47:31.178354 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:31.178317    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6947749cfc-lqv8n_208e16c1-b8e1-475e-ae2d-e62116f8ab3f/check-endpoints/0.log"
Jun 11 21:47:31.252486 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:31.252456    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xmqg8_7248b06e-830b-4364-b36e-29591627e6b3/network-check-target-container/0.log"
Jun 11 21:47:32.193063 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:32.193039    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qp75j_17cfa36f-4b08-4cf8-9ec9-576e2b1e40dd/iptables-alerter/0.log"
Jun 11 21:47:32.943123 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:32.943084    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qb7sn_2a1f7c46-913b-488d-a70c-15c92addac5e/tuned/0.log"
Jun 11 21:47:34.798041 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:34.798005    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-xpwjd_28dec8c8-e072-4263-bc96-033fa375e3c3/cluster-samples-operator/0.log"
Jun 11 21:47:34.817918 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:34.817888    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-xpwjd_28dec8c8-e072-4263-bc96-033fa375e3c3/cluster-samples-operator-watch/0.log"
Jun 11 21:47:35.720340 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:35.720300    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-7ccbfd59dc-r2ctj_dc4206ba-184c-4bdf-947f-d4c6e553eb6e/service-ca-operator/1.log"
Jun 11 21:47:35.721571 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:35.721546    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-7ccbfd59dc-r2ctj_dc4206ba-184c-4bdf-947f-d4c6e553eb6e/service-ca-operator/0.log"
Jun 11 21:47:36.104766 ip-10-0-133-9 kubenswrapper[2570]: I0611 21:47:36.104733    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7b994bc59-k99cn_20201dae-1d8c-4024-b95d-1d1872aa3b64/service-ca-controller/0.log"