May 28 10:02:53.316350 ip-10-0-133-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 10:02:53.316359 ip-10-0-133-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 10:02:53.316366 ip-10-0-133-103 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 10:02:53.316603 ip-10-0-133-103 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 10:03:03.421401 ip-10-0-133-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 10:03:03.421423 ip-10-0-133-103 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f7b032db5bfb417cb1a5b81157f0ffc7 --
May 28 10:05:16.970348 ip-10-0-133-103 systemd[1]: Starting Kubernetes Kubelet...
May 28 10:05:17.478265 ip-10-0-133-103 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:17.478265 ip-10-0-133-103 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 10:05:17.478265 ip-10-0-133-103 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:17.478265 ip-10-0-133-103 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 10:05:17.478265 ip-10-0-133-103 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 10:05:17.480143 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.480046    2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487375    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487401    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487406    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487410    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487413    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:17.487407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487417    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487421    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487425    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487429    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487432    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487436    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487439    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487446    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487452    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487457    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487460    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487465    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487469    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487474    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487478    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487482    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487485    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487488    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487492    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:17.487778 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487495    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487498    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487502    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487514    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487518    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487522    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487526    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487529    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487533    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487537    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487540    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487545    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487548    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487552    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487557    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487562    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487566    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487570    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487583    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487589    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:17.488571 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487594    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487598    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487603    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487607    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487611    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487615    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487619    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487623    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487628    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487633    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487637    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487642    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487646    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487650    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487654    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487659    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487662    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487666    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487671    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:17.489266 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487675    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487682    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487687    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487692    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487696    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487701    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487705    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487709    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487714    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487718    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487723    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487727    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487732    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487738    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487742    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487749    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487754    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487758    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487762    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487766    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:17.489886 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487771    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487775    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.487779    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488485    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488496    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488502    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488506    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488510    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488515    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488520    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488524    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488530    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488536    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488541    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488545    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488550    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488555    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488559    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488564    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:17.490746 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488568    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488572    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488576    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488580    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488584    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488588    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488592    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488596    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488602    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488606    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488610    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488614    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488618    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488622    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488626    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488630    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488634    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488638    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488642    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488646    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:17.491509 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488651    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488654    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488659    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488662    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488666    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488671    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488676    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488680    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488684    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488689    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488693    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488699    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488703    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488707    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488712    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488716    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488720    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488724    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488728    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:17.492040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488735    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488741    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488748    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488753    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488758    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488762    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488767    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488772    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488776    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488780    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488784    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488788    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488792    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488796    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488800    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488805    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488808    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488813    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488817    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488821    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:17.492754 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488825    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488835    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488840    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488846    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488850    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488855    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488859    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488863    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488867    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488872    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.488876    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489771    2556 flags.go:64] FLAG: --address="0.0.0.0"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489790    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489801    2556 flags.go:64] FLAG: --anonymous-auth="true"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489808    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489817    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489823    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489829    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489836    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489841    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489846    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 10:05:17.493279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489853    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489859    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489865    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489870    2556 flags.go:64] FLAG: --cgroup-root=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489875    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489883    2556 flags.go:64] FLAG: --client-ca-file=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489888    2556 flags.go:64] FLAG: --cloud-config=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489893    2556 flags.go:64] FLAG: --cloud-provider="external"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489898    2556 flags.go:64] FLAG: --cluster-dns="[]"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489904    2556 flags.go:64] FLAG: --cluster-domain=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489909    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489914    2556 flags.go:64] FLAG: --config-dir=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489921    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489927    2556 flags.go:64] FLAG: --container-log-max-files="5"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489933    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489938    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489943    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489949    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489954    2556 flags.go:64] FLAG: --contention-profiling="false"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489959    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489964    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489970    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489974    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489981    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489986    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 10:05:17.493856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489991    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.489996    2556 flags.go:64] FLAG: --enable-load-reader="false"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490019    2556 flags.go:64] FLAG: --enable-server="true"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490025    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490033    2556 flags.go:64] FLAG: --event-burst="100"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490038    2556 flags.go:64] FLAG: --event-qps="50"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490043    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490048    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490052    2556 flags.go:64] FLAG: --eviction-hard=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490059    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490064    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490070    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490076    2556 flags.go:64] FLAG: --eviction-soft=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490081    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490085    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490090    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490096    2556 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490100    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490105    2556 flags.go:64] FLAG: --fail-swap-on="true"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490112    2556 flags.go:64] FLAG: --feature-gates=""
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490118    2556 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490123    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490128    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490134    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490138    2556 flags.go:64] FLAG: --healthz-port="10248"
May 28 10:05:17.494522 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490143    2556 flags.go:64] FLAG: --help="false"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490148    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-103.ec2.internal"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490154    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490159    2556 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490164    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490170    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490176    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490181    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490186    2556 flags.go:64] FLAG: --image-service-endpoint=""
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490192    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490205    2556 flags.go:64] FLAG: --kube-api-burst="100"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490210    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490215    2556 flags.go:64] FLAG: --kube-api-qps="50"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490220    2556 flags.go:64] FLAG: --kube-reserved=""
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490226    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490231    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490236    2556 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490241    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490246    2556 flags.go:64] FLAG: --lock-file=""
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490251    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490256    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490261    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490270    2556 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 10:05:17.495144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490275    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490280    2556 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490284    2556 flags.go:64] FLAG: --logging-format="text"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490291    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490297    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490302    2556 flags.go:64] FLAG: --manifest-url=""
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490307    2556 flags.go:64] FLAG: --manifest-url-header=""
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490314    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490319    2556 flags.go:64] FLAG: --max-open-files="1000000"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490326    2556 flags.go:64] FLAG: --max-pods="110"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490331    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490335    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490340    2556 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490345    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490350    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490356    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490361    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490372    2556 flags.go:64] FLAG: --node-status-max-images="50"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490378    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490383    2556 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490389    2556 flags.go:64] FLAG: --pod-cidr=""
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490394    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490403    2556 flags.go:64] FLAG: --pod-manifest-path=""
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490408    2556 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 10:05:17.495723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490414    2556 flags.go:64] FLAG: --pods-per-core="0"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490418    2556 flags.go:64] FLAG: --port="10250"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490423    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490429    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-053f2a3f022c18840"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490434    2556 flags.go:64] FLAG: --qos-reserved=""
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490440    2556 flags.go:64] FLAG: --read-only-port="10255"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490445    2556 flags.go:64] FLAG: --register-node="true"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490449    2556 flags.go:64] FLAG: --register-schedulable="true"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490454    2556 flags.go:64] FLAG: --register-with-taints=""
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490460    2556 flags.go:64] FLAG: --registry-burst="10"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490466    2556 flags.go:64] FLAG: --registry-qps="5"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490470    2556 flags.go:64] FLAG: --reserved-cpus=""
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490477    2556 flags.go:64] FLAG: --reserved-memory=""
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490492    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490497    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490502    2556 flags.go:64] FLAG: --rotate-certificates="false"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490507    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490511    2556 flags.go:64] FLAG: --runonce="false"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490516    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490521    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490526    2556 flags.go:64] FLAG: --seccomp-default="false"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490531    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490535    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490540    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490545    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490551    2556 flags.go:64] FLAG: --storage-driver-password="root"
May 28 10:05:17.496320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490556    2556 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490561    2556 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490566    2556 flags.go:64] FLAG: --storage-driver-user="root"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490571    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490577    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490582    2556 flags.go:64] FLAG: --system-cgroups=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490586    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490595    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490601    2556 flags.go:64] FLAG: --tls-cert-file=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490605    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490612    2556 flags.go:64] FLAG: --tls-min-version=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490616    2556 flags.go:64] FLAG: --tls-private-key-file=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490621    2556 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490625    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490630    2556 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490635    2556 flags.go:64] FLAG: --v="2"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490643    2556 flags.go:64] FLAG: --version="false"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490649    2556 flags.go:64] FLAG: --vmodule=""
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490658    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.490664    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490816    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490823    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490828    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490833    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:17.497041 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490837    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490842    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490846    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490849    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490854    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490858    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490862    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490867    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490872    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490876    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490880    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490884    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490892    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490896    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490901    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490905    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490910    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490914    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490918    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490922    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:17.497648 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490926    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490930    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490935    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490939    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490944    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490948    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490954    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490958    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490964    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490968    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490972    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490977    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490981    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490985    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490990    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490994    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.490998    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491019    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491024    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491028    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:17.498182 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491033    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491037    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491041    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491046    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491052    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491057    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491061    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491065    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491072    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491079    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491083    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491088    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491092    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491096    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491100    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491104    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491108    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491112    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491118    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:17.498688 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491125    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491132    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491138    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491143    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491149    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491154    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491158    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491163    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491168    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491172    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491176    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491181    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491185    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491190    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491194    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491199    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491203    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491209    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491213    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491218    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:17.499194 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491224    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491228    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.491232    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.491240    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.499173    2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.499192    2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499244    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499249    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499253    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499256    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499260    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499263    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499266    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499269    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499271    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499274    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:17.499684 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499276    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499279    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499282    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499284    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499287    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499290    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499293    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499295    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499298    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499300    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499303    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499306    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499308    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499311    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499313    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499316    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499319    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499321    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499324    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499326    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:17.500108 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499329    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499334    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499337    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499340    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499342    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499345    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499349    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499353    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499356    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499359    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499362    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499365    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499368    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499370    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499373    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499377    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499380    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499383    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:17.500645 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499385    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499388    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499391    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499393    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499396    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499399    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499401    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499403    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499406    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499409    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499412    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499414    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499417    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499419    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499422    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499425    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499429    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499432    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499435    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499438    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:17.501107 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499440    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499443    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499446    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499448    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499451    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499453    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499456    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499459    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499461    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499464    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499466    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499469    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499472    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499475    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499477    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499480    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499483    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:17.501604 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499485    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.499490    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499604    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499609    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499612    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499615    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499618    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499620    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499623    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499627    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499630    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499633    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499636    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499639    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499642    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 10:05:17.502082 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499644    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499647    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499649    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499652    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499655    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499658    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499660    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499663    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499665    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499669    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499673    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499676    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499679    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499681    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499684    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499687    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499690    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499693    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499696    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 10:05:17.502449 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499698    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499701    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499704    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499708    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499711    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499713    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499716    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499719    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499722    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499724    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499727    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499731    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499733    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499736    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499738    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499741    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499743    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499746    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499748    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 10:05:17.502916 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499751    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499753    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499756    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499758    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499761    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499764    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499766    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499769    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499771    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499774    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499777    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499779    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499782    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499785    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499787    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499790    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499792    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499795    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499798    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499801    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 10:05:17.503407 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499803    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499806    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499809    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499811    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499814    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499817    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499820    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499823    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499825    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499828    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499830    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499833    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499835    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499837    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:17.499840    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.499845    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 10:05:17.503925 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.500781    2556 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 10:05:17.504372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.503128    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 10:05:17.504372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.504179    2556 server.go:1019] "Starting client certificate rotation"
May 28 10:05:17.504372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.504276    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 10:05:17.504372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.504314    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 10:05:17.533032 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.532996    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 10:05:17.535167 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.535151    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 10:05:17.547513 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.547491    2556 log.go:25] "Validated CRI v1 runtime API"
May 28 10:05:17.553241 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.553225    2556 log.go:25] "Validated CRI v1 image API"
May 28 10:05:17.555209 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.555193    2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 10:05:17.557772 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.557751    2556 fs.go:135] Filesystem UUIDs: map[0a0f1a2b-2eb9-4df8-8b1f-c702ccd17fb5:/dev/nvme0n1p3 7821bb5d-e642-4332-8c6e-600e4cb144fe:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 28 10:05:17.557832 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.557772    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 10:05:17.562032 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.561914    2556 manager.go:217] Machine: {Timestamp:2026-05-28 10:05:17.561412092 +0000 UTC m=+0.454980372 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100262 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec241ef527e1ff6a79bf16bfd1398eb0 SystemUUID:ec241ef5-27e1-ff6a-79bf-16bfd1398eb0 BootID:f7b032db-5bfb-417c-b1a5-b81157f0ffc7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7a:b8:41:75:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7a:b8:41:75:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:22:29:cb:95:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 10:05:17.562771 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.562760    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 10:05:17.562896 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.562883    2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 10:05:17.565929 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.565911    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 10:05:17.566909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.566888    2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 10:05:17.567057 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.566911    2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 10:05:17.567107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.567066    2556 topology_manager.go:138] "Creating topology manager with none policy"
May 28 10:05:17.567107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.567075    2556 container_manager_linux.go:306] "Creating device plugin manager"
May 28 10:05:17.567107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.567082    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 10:05:17.567977 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.567967    2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 10:05:17.570333 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.570320    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 10:05:17.570450 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.570441    2556 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 10:05:17.573234 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.573224    2556 kubelet.go:491] "Attempting to sync node with API server"
May 28 10:05:17.573275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.573237    2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 10:05:17.573275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.573247    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 10:05:17.573275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.573256    2556 kubelet.go:397] "Adding apiserver pod source"
May 28 10:05:17.573275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.573267    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 10:05:17.574575 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.574563    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 10:05:17.574629 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.574582    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 10:05:17.578108 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.578093    2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 10:05:17.580445 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.580432    2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 10:05:17.581401 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581390    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 10:05:17.581437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581407    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 10:05:17.581437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581414    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 10:05:17.581437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581420    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 10:05:17.581437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581429    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 10:05:17.581437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581435    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 10:05:17.581572 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581442    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 10:05:17.581572 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581447    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 10:05:17.581572 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581455    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 10:05:17.581572 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581461    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 10:05:17.581572 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581477    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 10:05:17.581949 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.581940    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 10:05:17.583028 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.583017    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 10:05:17.583068 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.583029    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 10:05:17.586367 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.586351    2556 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 10:05:17.586442 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.586387    2556 server.go:1295] "Started kubelet"
May 28 10:05:17.586570 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.586475    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 10:05:17.586667 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.586550    2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 10:05:17.586667 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.586636    2556 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 10:05:17.587093 ip-10-0-133-103 systemd[1]: Started Kubernetes Kubelet.
May 28 10:05:17.588104 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.588089    2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 10:05:17.589639 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.589616    2556 server.go:317] "Adding debug handlers to kubelet server"
May 28 10:05:17.594958 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.594934    2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 10:05:17.595715 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.595681    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 10:05:17.595819 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.595756    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 10:05:17.599115 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.598118    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-103.ec2.internal.18b3b2a9372c91fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-103.ec2.internal,UID:ip-10-0-133-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-103.ec2.internal,},FirstTimestamp:2026-05-28 10:05:17.586362877 +0000 UTC m=+0.479931139,LastTimestamp:2026-05-28 10:05:17.586362877 +0000 UTC m=+0.479931139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-103.ec2.internal,}"
May 28 10:05:17.599526 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.599496    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 10:05:17.599651 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.599629    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvkvz"
May 28 10:05:17.599724 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.599645    2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 10:05:17.600195 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600177    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 10:05:17.600546 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600529    2556 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 10:05:17.600546 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600545    2556 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 10:05:17.600689 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600579    2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 10:05:17.600742 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600686    2556 reconstruct.go:97] "Volume reconstruction finished"
May 28 10:05:17.600742 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.600699    2556 reconciler.go:26] "Reconciler: start to sync state"
May 28 10:05:17.601076 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.601058    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:17.601212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601197    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 10:05:17.601212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601214    2556 factory.go:55] Registering systemd factory
May 28 10:05:17.601212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601224    2556 factory.go:223] Registration of the systemd container factory successfully
May 28 10:05:17.601458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601441    2556 factory.go:153] Registering CRI-O factory
May 28 10:05:17.601458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601459    2556 factory.go:223] Registration of the crio container factory successfully
May 28 10:05:17.601593 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601478    2556 factory.go:103] Registering Raw factory
May 28 10:05:17.601593 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601491    2556 manager.go:1196] Started watching for new ooms in manager
May 28 10:05:17.601891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.601879    2556 manager.go:319] Starting recovery of all containers
May 28 10:05:17.605497 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.605468    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 10:05:17.605619 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.605593    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 10:05:17.609800 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.609781    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvkvz"
May 28 10:05:17.611967 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.611952    2556 manager.go:324] Recovery completed
May 28 10:05:17.615519 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.615502    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.618115 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618101    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.618185 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618131    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.618185 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618145    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.618664 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618650    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 10:05:17.618664 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618661    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 10:05:17.618775 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.618675    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 10:05:17.621610 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.621548    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-103.ec2.internal.18b3b2a9391113a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-103.ec2.internal,UID:ip-10-0-133-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-103.ec2.internal,},FirstTimestamp:2026-05-28 10:05:17.618115495 +0000 UTC m=+0.511683757,LastTimestamp:2026-05-28 10:05:17.618115495 +0000 UTC m=+0.511683757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-103.ec2.internal,}"
May 28 10:05:17.621918 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.621907    2556 policy_none.go:49] "None policy: Start"
May 28 10:05:17.621968 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.621923    2556 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 10:05:17.621968 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.621934    2556 state_mem.go:35] "Initializing new in-memory state store"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.665541    2556 manager.go:341] "Starting Device Plugin manager"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.665634    2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.665650    2556 server.go:85] "Starting device plugin registration server"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.665881    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.665891    2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.666052    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.666140    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.666147    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.666573    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 10:05:17.679148 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.666607    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:17.695394 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.695368    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 10:05:17.696514 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.696498    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 10:05:17.696560 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.696526    2556 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 10:05:17.696560 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.696547    2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 10:05:17.696560 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.696556    2556 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 10:05:17.696664 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.696599    2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 10:05:17.699407 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.699389    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:17.766624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.766539    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.768820 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.768792    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.768969 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.768834    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.768969 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.768848    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.768969 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.768876    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-103.ec2.internal"
May 28 10:05:17.779510 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.779486    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-103.ec2.internal"
May 28 10:05:17.779620 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.779517    2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-103.ec2.internal\": node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:17.797101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.797055    2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"]
May 28 10:05:17.797253 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.797148    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.798058 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.798041    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.798164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.798073    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.798164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.798086    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.799098 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799086    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.799272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799256    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:17.799316 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799290    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.799790 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799766    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.799790 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799789    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.799920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799802    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.799920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799832    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.799920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799856    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.799920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.799870    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.800847 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.800831    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:17.800907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.800857    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 10:05:17.801556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.801541    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientMemory"
May 28 10:05:17.801635 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.801571    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasNoDiskPressure"
May 28 10:05:17.801635 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.801585    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeHasSufficientPID"
May 28 10:05:17.801771 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.801755    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:17.818658 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.818625    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-103.ec2.internal\" not found" node="ip-10-0-133-103.ec2.internal"
May 28 10:05:17.823061 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.823037    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-103.ec2.internal\" not found" node="ip-10-0-133-103.ec2.internal"
May 28 10:05:17.901663 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.901622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:17.901663 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.901665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:17.901858 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:17.901691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/810ac29c36d8ca42a5ce8d8f9964b08e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-103.ec2.internal\" (UID: \"810ac29c36d8ca42a5ce8d8f9964b08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:17.902665 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:17.902633    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.001988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.001952    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.001988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.001986    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.002213 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.002018    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/810ac29c36d8ca42a5ce8d8f9964b08e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-103.ec2.internal\" (UID: \"810ac29c36d8ca42a5ce8d8f9964b08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.002213 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.002064    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/810ac29c36d8ca42a5ce8d8f9964b08e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-103.ec2.internal\" (UID: \"810ac29c36d8ca42a5ce8d8f9964b08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.002213 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.002070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.002213 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.002113    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63f91d1c882e3bbcd9e885361169af02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal\" (UID: \"63f91d1c882e3bbcd9e885361169af02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.002995 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.002977    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.103611 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.103536    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.120648 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.120622    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.125423 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.125401    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.204172 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.204135    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.304598 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.304565    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.405127 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.405036    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.504547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.504509    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 10:05:18.505200 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.504696    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 10:05:18.505607 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.505581    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.600104 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.600069    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 10:05:18.607061 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:18.607040    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-103.ec2.internal\" not found"
May 28 10:05:18.611608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.611579    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 10:00:17 +0000 UTC" deadline="2028-03-07 19:07:47.614791458 +0000 UTC"
May 28 10:05:18.611608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.611605    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15585h2m29.003189688s"
May 28 10:05:18.615760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.615739    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 10:05:18.615866 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.615853    2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:18.653971 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:18.653938    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810ac29c36d8ca42a5ce8d8f9964b08e.slice/crio-3289a6956817d09ca32da86794b8368cd5d9096a414ad6cfc6590f731bf0af70 WatchSource:0}: Error finding container 3289a6956817d09ca32da86794b8368cd5d9096a414ad6cfc6590f731bf0af70: Status 404 returned error can't find the container with id 3289a6956817d09ca32da86794b8368cd5d9096a414ad6cfc6590f731bf0af70
May 28 10:05:18.654205 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:18.654183    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f91d1c882e3bbcd9e885361169af02.slice/crio-ebfeb7df04454e55868e3ccbc85ee0bef6a6ddeacca029311456979dad749dea WatchSource:0}: Error finding container ebfeb7df04454e55868e3ccbc85ee0bef6a6ddeacca029311456979dad749dea: Status 404 returned error can't find the container with id ebfeb7df04454e55868e3ccbc85ee0bef6a6ddeacca029311456979dad749dea
May 28 10:05:18.657209 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.657195    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:05:18.682574 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.682550    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-99xvv"
May 28 10:05:18.693671 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.693652    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-99xvv"
May 28 10:05:18.699360 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.699313    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal" event={"ID":"810ac29c36d8ca42a5ce8d8f9964b08e","Type":"ContainerStarted","Data":"3289a6956817d09ca32da86794b8368cd5d9096a414ad6cfc6590f731bf0af70"}
May 28 10:05:18.700107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.700090    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal" event={"ID":"63f91d1c882e3bbcd9e885361169af02","Type":"ContainerStarted","Data":"ebfeb7df04454e55868e3ccbc85ee0bef6a6ddeacca029311456979dad749dea"}
May 28 10:05:18.701202 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.701190    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.718463 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.718439    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 10:05:18.720732 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.720709    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal"
May 28 10:05:18.731763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.731742    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 10:05:18.742715 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:18.742693    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:19.011898 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.011871    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:19.349035 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.348940    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 10:05:19.574854 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.574810    2556 apiserver.go:52] "Watching apiserver"
May 28 10:05:19.587856 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.587821    2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 10:05:19.590258 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.590223    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds","openshift-cluster-node-tuning-operator/tuned-4zfwm","openshift-network-operator/iptables-alerter-8fb22","openshift-ovn-kubernetes/ovnkube-node-xmh9c","kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal","openshift-dns/node-resolver-f46zp","openshift-image-registry/node-ca-c7hrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-dmpj4","openshift-multus/multus-k8wgv","openshift-multus/network-metrics-daemon-zhdk7","openshift-network-diagnostics/network-check-target-gqlck","kube-system/konnectivity-agent-hmlwc"]
May 28 10:05:19.592724 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.592701    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.594712 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.594691    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.595743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.595724    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 10:05:19.595743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.595727    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 10:05:19.595891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.595793    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qwh27\""
May 28 10:05:19.595891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.595728    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 10:05:19.596675 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.596656    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.598266 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.598108    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 10:05:19.599174 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.598454    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 10:05:19.599174 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.598691    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5f2gn\""
May 28 10:05:19.599642 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.599431    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2xbk8\""
May 28 10:05:19.600785 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.600723    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.602308 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.602291    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 10:05:19.602738 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.602713    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.602738 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.602748    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 10:05:19.602985 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.602967    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 10:05:19.603276 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603259    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 10:05:19.603356 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603304    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 10:05:19.603415 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603359    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 10:05:19.603602 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603579    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 10:05:19.603813 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603796    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 10:05:19.603897 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603803    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kg27\""
May 28 10:05:19.603962 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.603939    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 10:05:19.604966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.604952    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.605637 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.605612    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 10:05:19.605971 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.605956    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 10:05:19.606156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.606138    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vq75v\""
May 28 10:05:19.607202 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.607183    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 10:05:19.607296 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.607197    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.607408 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.607284    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:19.607408 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.607336    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 10:05:19.607511 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.607500    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 10:05:19.607565 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.607553    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-58dp7\""
May 28 10:05:19.609420 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.609406    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:19.609509 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.609468    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:19.610825 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.610911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-tuned\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.610911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-tmp\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.610911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-systemd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.610911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-config\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovn-node-metrics-cert\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610963    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b2ce129-fabb-4741-9581-91c7796d802f-hosts-file\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.610986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bb2718-46bb-495e-a103-52fa11211d97-host-slash\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-bin\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-netd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-script-lib\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611111 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-serviceca\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysconfig\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-kubernetes\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6hs\" (UniqueName: \"kubernetes.io/projected/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-kube-api-access-nx6hs\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611224    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-netns\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-kubelet\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611315    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-ovn\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-log-socket\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b2ce129-fabb-4741-9581-91c7796d802f-tmp-dir\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611397    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmznr\" (UniqueName: \"kubernetes.io/projected/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-kube-api-access-gmznr\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-host\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mf5\" (UniqueName: \"kubernetes.io/projected/52bb2718-46bb-495e-a103-52fa11211d97-kube-api-access-86mf5\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfv24\" (UniqueName: \"kubernetes.io/projected/6b2ce129-fabb-4741-9581-91c7796d802f-kube-api-access-hfv24\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-modprobe-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.611518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-run\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52bb2718-46bb-495e-a103-52fa11211d97-iptables-alerter-script\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611568    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-systemd-units\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-var-lib-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-node-log\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-env-overrides\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611666    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-conf\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-systemd\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-lib-modules\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-slash\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-etc-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-host\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-sys\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-var-lib-kubelet\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.612222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.611874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sl96\" (UniqueName: \"kubernetes.io/projected/e32fb6e9-90d6-48ec-8859-bbea1670da36-kube-api-access-7sl96\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.613989 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.613971    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.614763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.614743    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 10:05:19.614855 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.614771    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 10:05:19.615351 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.615316    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gf9gb\""
May 28 10:05:19.616208 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.616191    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cx56m\""
May 28 10:05:19.616431 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.616397    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 10:05:19.616536 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.616408    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.616916 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.616896    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 10:05:19.617245 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.617225    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 10:05:19.617245 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.617251    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 10:05:19.617391 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.617311    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 10:05:19.618571 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.618555    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 10:05:19.618791 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.618774    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x8lkg\""
May 28 10:05:19.694362 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.694319    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:18 +0000 UTC" deadline="2027-12-16 03:46:45.974399959 +0000 UTC"
May 28 10:05:19.694362 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.694357    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13601h41m26.280047184s"
May 28 10:05:19.701812 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.701789    2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 10:05:19.712988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.712956    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b2ce129-fabb-4741-9581-91c7796d802f-tmp-dir\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.713139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713020    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmznr\" (UniqueName: \"kubernetes.io/projected/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-kube-api-access-gmznr\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.713139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.713139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.713139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-hostroot\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.713305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713217    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-run\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-systemd-units\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713249    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-env-overrides\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7zs\" (UniqueName: \"kubernetes.io/projected/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-kube-api-access-xc7zs\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b2ce129-fabb-4741-9581-91c7796d802f-tmp-dir\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713345    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-systemd-units\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713323    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-run\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb88c\" (UniqueName: \"kubernetes.io/projected/7a59feb0-2126-414c-b5b1-7faa7a855785-kube-api-access-rb88c\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713416    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-conf\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713432    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-systemd\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713447    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-slash\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cni-binary-copy\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.713483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-etc-kubernetes\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713491    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-systemd\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713501    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-host\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713520    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-var-lib-kubelet\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713531    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-slash\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713543    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sl96\" (UniqueName: \"kubernetes.io/projected/e32fb6e9-90d6-48ec-8859-bbea1670da36-kube-api-access-7sl96\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713562    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-system-cni-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713571    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-var-lib-kubelet\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713540    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-conf\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713593    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-host\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk45d\" (UniqueName: \"kubernetes.io/projected/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-kube-api-access-gk45d\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713682    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-tuned\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713690    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-env-overrides\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713698    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713736    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovn-node-metrics-cert\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-kubelet\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713770    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.713907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713841    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b2ce129-fabb-4741-9581-91c7796d802f-hosts-file\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713874    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-bin\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713906    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-bin\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713918    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713945    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b2ce129-fabb-4741-9581-91c7796d802f-hosts-file\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.713921    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-script-lib\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714121    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-daemon-config\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714149    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysconfig\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714174    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-kubernetes\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714198    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6hs\" (UniqueName: \"kubernetes.io/projected/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-kube-api-access-nx6hs\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714221    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714232    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysconfig\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714245    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-k8s-cni-cncf-io\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.714673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714283    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-kubernetes\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-netns\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714316    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-log-socket\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714346    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-device-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714389    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-host\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714400    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-log-socket\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714410    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-script-lib\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714411    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86mf5\" (UniqueName: \"kubernetes.io/projected/52bb2718-46bb-495e-a103-52fa11211d97-kube-api-access-86mf5\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-system-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714477    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-host\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714536    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfv24\" (UniqueName: \"kubernetes.io/projected/6b2ce129-fabb-4741-9581-91c7796d802f-kube-api-access-hfv24\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714574    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-modprobe-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714635    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52bb2718-46bb-495e-a103-52fa11211d97-iptables-alerter-script\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714861    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-var-lib-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.715338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714694    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-modprobe-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714887    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-node-log\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714914    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-node-log\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cnibin\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714940    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-var-lib-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.714984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-socket-dir-parent\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715028    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-lib-modules\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715057    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-etc-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbzg\" (UniqueName: \"kubernetes.io/projected/a0f466b4-f772-4529-abcb-12e086451531-kube-api-access-nzbzg\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715092    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-lib-modules\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a56e86f-ebb8-42d1-89fe-28860f216bf1-konnectivity-ca\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715112    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/52bb2718-46bb-495e-a103-52fa11211d97-iptables-alerter-script\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715123    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-etc-openvswitch\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715135    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-sys\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-os-release\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715166    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-sys\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-os-release\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-conf-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a56e86f-ebb8-42d1-89fe-28860f216bf1-agent-certs\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715275    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715297    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-tmp\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715343    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-systemd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715366    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-config\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715389    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bb2718-46bb-495e-a103-52fa11211d97-host-slash\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715395    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-sysctl-d\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715413    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-netd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715413    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-systemd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715450    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bb2718-46bb-495e-a103-52fa11211d97-host-slash\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715485    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-cni-netd\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715519    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-serviceca\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715543    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-netns\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715590    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-run-netns\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.716556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-multus\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715625    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-multus-certs\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715783    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-kubelet\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715807    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-ovn\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715855    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-run-ovn\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715878    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-kubelet\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715884    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cnibin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-bin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.715940    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovnkube-config\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.716020    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-serviceca\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.717173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.716054    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e32fb6e9-90d6-48ec-8859-bbea1670da36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717730 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.717203    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-etc-tuned\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.717730 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.717365    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e32fb6e9-90d6-48ec-8859-bbea1670da36-ovn-node-metrics-cert\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.717730 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.717552    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-tmp\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.730606 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.730398    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmznr\" (UniqueName: \"kubernetes.io/projected/a84a19c4-fc9a-43b1-b80b-de995de2bfc9-kube-api-access-gmznr\") pod \"node-ca-c7hrj\" (UID: \"a84a19c4-fc9a-43b1-b80b-de995de2bfc9\") " pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.731279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.731253    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6hs\" (UniqueName: \"kubernetes.io/projected/1dd7b734-bcae-41f2-82cb-3f86e58e8e72-kube-api-access-nx6hs\") pod \"tuned-4zfwm\" (UID: \"1dd7b734-bcae-41f2-82cb-3f86e58e8e72\") " pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.731509 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.731471    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sl96\" (UniqueName: \"kubernetes.io/projected/e32fb6e9-90d6-48ec-8859-bbea1670da36-kube-api-access-7sl96\") pod \"ovnkube-node-xmh9c\" (UID: \"e32fb6e9-90d6-48ec-8859-bbea1670da36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.731836 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.731811    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mf5\" (UniqueName: \"kubernetes.io/projected/52bb2718-46bb-495e-a103-52fa11211d97-kube-api-access-86mf5\") pod \"iptables-alerter-8fb22\" (UID: \"52bb2718-46bb-495e-a103-52fa11211d97\") " pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.732313 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.732295    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfv24\" (UniqueName: \"kubernetes.io/projected/6b2ce129-fabb-4741-9581-91c7796d802f-kube-api-access-hfv24\") pod \"node-resolver-f46zp\" (UID: \"6b2ce129-fabb-4741-9581-91c7796d802f\") " pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.816791 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816751    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cni-binary-copy\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.816950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816806    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-etc-kubernetes\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.816950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816836    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-system-cni-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.816950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816864    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk45d\" (UniqueName: \"kubernetes.io/projected/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-kube-api-access-gk45d\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.816950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816918    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-etc-kubernetes\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.816950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-system-cni-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.816978    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-kubelet\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817033    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817066    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817094    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817119    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-daemon-config\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817147    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817144    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-registration-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817189    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817192    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-k8s-cni-cncf-io\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817227    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-k8s-cni-cncf-io\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817232    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-netns\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817093    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-kubelet\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817279    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-netns\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817282    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817310    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817338    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-device-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817367    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-system-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817375    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cni-binary-copy\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817391    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817422    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cnibin\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817423    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-device-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817449    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817477    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-socket-dir-parent\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817503    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817505    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbzg\" (UniqueName: \"kubernetes.io/projected/a0f466b4-f772-4529-abcb-12e086451531-kube-api-access-nzbzg\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817533    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a56e86f-ebb8-42d1-89fe-28860f216bf1-konnectivity-ca\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cnibin\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817559    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-os-release\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.817838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817578    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-os-release\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817594    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-conf-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817609    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a56e86f-ebb8-42d1-89fe-28860f216bf1-agent-certs\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817644    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817642    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-socket-dir-parent\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817663    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-multus\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817679    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-multus-certs\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817694    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817715    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cnibin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817718    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-os-release\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817713    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-daemon-config\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817762    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-cnibin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817762    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-sys-fs\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817790    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-multus-conf-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817798    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-etc-selinux\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817801    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-multus\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-run-multus-certs\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.818673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817852    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-os-release\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817875    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-system-cni-dir\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817900    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-bin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817916    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817932    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817947    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-hostroot\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.817973    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7zs\" (UniqueName: \"kubernetes.io/projected/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-kube-api-access-xc7zs\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818017    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818041    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb88c\" (UniqueName: \"kubernetes.io/projected/7a59feb0-2126-414c-b5b1-7faa7a855785-kube-api-access-rb88c\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818053    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818071    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-host-var-lib-cni-bin\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818115    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-hostroot\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.818153    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818216    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a59feb0-2126-414c-b5b1-7faa7a855785-socket-dir\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.818289    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:20.318233177 +0000 UTC m=+3.211801455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818335    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a56e86f-ebb8-42d1-89fe-28860f216bf1-konnectivity-ca\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.819547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.818584    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.820728 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.820692    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a56e86f-ebb8-42d1-89fe-28860f216bf1-agent-certs\") pod \"konnectivity-agent-hmlwc\" (UID: \"5a56e86f-ebb8-42d1-89fe-28860f216bf1\") " pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.828377 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.828350    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk45d\" (UniqueName: \"kubernetes.io/projected/2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73-kube-api-access-gk45d\") pod \"multus-k8wgv\" (UID: \"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73\") " pod="openshift-multus/multus-k8wgv"
May 28 10:05:19.838322 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.838303    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:19.838430 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.838328    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:19.838430 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.838343    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:19.838430 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:19.838413    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:20.338393236 +0000 UTC m=+3.231961507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:19.842524 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.842497    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb88c\" (UniqueName: \"kubernetes.io/projected/7a59feb0-2126-414c-b5b1-7faa7a855785-kube-api-access-rb88c\") pod \"aws-ebs-csi-driver-node-t6gds\" (UID: \"7a59feb0-2126-414c-b5b1-7faa7a855785\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.842661 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.842572    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7zs\" (UniqueName: \"kubernetes.io/projected/76df4a2b-f318-46f4-9977-4ec3d2fd4cf5-kube-api-access-xc7zs\") pod \"multus-additional-cni-plugins-dmpj4\" (UID: \"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5\") " pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.843380 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.843358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbzg\" (UniqueName: \"kubernetes.io/projected/a0f466b4-f772-4529-abcb-12e086451531-kube-api-access-nzbzg\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:19.904443 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.904344    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c7hrj"
May 28 10:05:19.911204 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.911182    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4zfwm"
May 28 10:05:19.922948 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.922927    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8fb22"
May 28 10:05:19.925866 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.925837    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:19.933643 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.933615    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f46zp"
May 28 10:05:19.940195 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.940171    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds"
May 28 10:05:19.947786 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.947766    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:19.955359 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.955340    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dmpj4"
May 28 10:05:19.960954 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:19.960935    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k8wgv"
May 28 10:05:20.216889 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.216857    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76df4a2b_f318_46f4_9977_4ec3d2fd4cf5.slice/crio-6f18422a9231f93f44fe625835e2db808151ceae4a0ffc38a54c5cf78c0afb3e WatchSource:0}: Error finding container 6f18422a9231f93f44fe625835e2db808151ceae4a0ffc38a54c5cf78c0afb3e: Status 404 returned error can't find the container with id 6f18422a9231f93f44fe625835e2db808151ceae4a0ffc38a54c5cf78c0afb3e
May 28 10:05:20.217375 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.217322    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a59feb0_2126_414c_b5b1_7faa7a855785.slice/crio-c54fd6f884dbef1adb52dc16431997854069921a8042d27fa26574209034a044 WatchSource:0}: Error finding container c54fd6f884dbef1adb52dc16431997854069921a8042d27fa26574209034a044: Status 404 returned error can't find the container with id c54fd6f884dbef1adb52dc16431997854069921a8042d27fa26574209034a044
May 28 10:05:20.218502 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.218482    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32fb6e9_90d6_48ec_8859_bbea1670da36.slice/crio-64bc78b912b7742ee59a07d87982bf1744c1db1ffb42a38d3f3619cbd8fb79b7 WatchSource:0}: Error finding container 64bc78b912b7742ee59a07d87982bf1744c1db1ffb42a38d3f3619cbd8fb79b7: Status 404 returned error can't find the container with id 64bc78b912b7742ee59a07d87982bf1744c1db1ffb42a38d3f3619cbd8fb79b7
May 28 10:05:20.221537 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.221406    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84a19c4_fc9a_43b1_b80b_de995de2bfc9.slice/crio-dc939adfb585795cc3499c92f478ded7a77299f8a018c54e5f85e8318234b667 WatchSource:0}: Error finding container dc939adfb585795cc3499c92f478ded7a77299f8a018c54e5f85e8318234b667: Status 404 returned error can't find the container with id dc939adfb585795cc3499c92f478ded7a77299f8a018c54e5f85e8318234b667
May 28 10:05:20.223436 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.223414    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bb2718_46bb_495e_a103_52fa11211d97.slice/crio-b91cfc0c5131f91ad228f76febfb047dc6175058de3eb2739404845c28b8baeb WatchSource:0}: Error finding container b91cfc0c5131f91ad228f76febfb047dc6175058de3eb2739404845c28b8baeb: Status 404 returned error can't find the container with id b91cfc0c5131f91ad228f76febfb047dc6175058de3eb2739404845c28b8baeb
May 28 10:05:20.223972 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.223951    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a56e86f_ebb8_42d1_89fe_28860f216bf1.slice/crio-9cab7e1cd67fd1fc64cbf067341c1ec371df7817e24d8923ee9d66042e66e35c WatchSource:0}: Error finding container 9cab7e1cd67fd1fc64cbf067341c1ec371df7817e24d8923ee9d66042e66e35c: Status 404 returned error can't find the container with id 9cab7e1cd67fd1fc64cbf067341c1ec371df7817e24d8923ee9d66042e66e35c
May 28 10:05:20.225693 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.225663    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ce129_fabb_4741_9581_91c7796d802f.slice/crio-352b29101d3739082e5007314b6be2a27650cd0d031880c70860a857f8eaaa8f WatchSource:0}: Error finding container 352b29101d3739082e5007314b6be2a27650cd0d031880c70860a857f8eaaa8f: Status 404 returned error can't find the container with id 352b29101d3739082e5007314b6be2a27650cd0d031880c70860a857f8eaaa8f
May 28 10:05:20.246880 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.246712    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c18d3f1_4b9b_4b6c_b090_e3bf3aa1cc73.slice/crio-d034adff3d644b38cb8b7fd4c9a8fdbc099fa29e52ba8dfaa6c002db0d13c980 WatchSource:0}: Error finding container d034adff3d644b38cb8b7fd4c9a8fdbc099fa29e52ba8dfaa6c002db0d13c980: Status 404 returned error can't find the container with id d034adff3d644b38cb8b7fd4c9a8fdbc099fa29e52ba8dfaa6c002db0d13c980
May 28 10:05:20.247525 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:05:20.247502    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd7b734_bcae_41f2_82cb_3f86e58e8e72.slice/crio-eaef884070d45e7b84f7f5a75678c26b748b455be3a3b0971d34d0d58de86fa0 WatchSource:0}: Error finding container eaef884070d45e7b84f7f5a75678c26b748b455be3a3b0971d34d0d58de86fa0: Status 404 returned error can't find the container with id eaef884070d45e7b84f7f5a75678c26b748b455be3a3b0971d34d0d58de86fa0
May 28 10:05:20.321322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.321295    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:20.321431 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.321416    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:20.321499 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.321467    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:21.321452086 +0000 UTC m=+4.215020347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:20.421980 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.421947    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:20.422194 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.422129    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:20.422194 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.422149    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:20.422194 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.422160    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:20.422336 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.422225    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:21.422207731 +0000 UTC m=+4.315775994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:20.694826 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.694788    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:18 +0000 UTC" deadline="2028-02-17 13:58:55.913750888 +0000 UTC"
May 28 10:05:20.694826 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.694820    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15123h53m35.218933558s"
May 28 10:05:20.697583 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.697134    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:20.697583 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:20.697250    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:20.712739 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.711965    2556 generic.go:358] "Generic (PLEG): container finished" podID="63f91d1c882e3bbcd9e885361169af02" containerID="055a3769d105fbe6e97793d25455e54f312ca75cbccfc2620f1b81ea414e29d1" exitCode=0
May 28 10:05:20.712739 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.712540    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal" event={"ID":"63f91d1c882e3bbcd9e885361169af02","Type":"ContainerDied","Data":"055a3769d105fbe6e97793d25455e54f312ca75cbccfc2620f1b81ea414e29d1"}
May 28 10:05:20.726728 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.726668    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hmlwc" event={"ID":"5a56e86f-ebb8-42d1-89fe-28860f216bf1","Type":"ContainerStarted","Data":"9cab7e1cd67fd1fc64cbf067341c1ec371df7817e24d8923ee9d66042e66e35c"}
May 28 10:05:20.730620 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.730587    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8fb22" event={"ID":"52bb2718-46bb-495e-a103-52fa11211d97","Type":"ContainerStarted","Data":"b91cfc0c5131f91ad228f76febfb047dc6175058de3eb2739404845c28b8baeb"}
May 28 10:05:20.734608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.734583    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c7hrj" event={"ID":"a84a19c4-fc9a-43b1-b80b-de995de2bfc9","Type":"ContainerStarted","Data":"dc939adfb585795cc3499c92f478ded7a77299f8a018c54e5f85e8318234b667"}
May 28 10:05:20.748047 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.748019    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"64bc78b912b7742ee59a07d87982bf1744c1db1ffb42a38d3f3619cbd8fb79b7"}
May 28 10:05:20.762408 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.762315    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerStarted","Data":"6f18422a9231f93f44fe625835e2db808151ceae4a0ffc38a54c5cf78c0afb3e"}
May 28 10:05:20.771237 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.770607    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal" event={"ID":"810ac29c36d8ca42a5ce8d8f9964b08e","Type":"ContainerStarted","Data":"327012cc0bf62889a5d66b6f7e44b60203a562a81e6c9d4e36b852a50290dbf8"}
May 28 10:05:20.795802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.795772    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4zfwm" event={"ID":"1dd7b734-bcae-41f2-82cb-3f86e58e8e72","Type":"ContainerStarted","Data":"eaef884070d45e7b84f7f5a75678c26b748b455be3a3b0971d34d0d58de86fa0"}
May 28 10:05:20.810802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.810744    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k8wgv" event={"ID":"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73","Type":"ContainerStarted","Data":"d034adff3d644b38cb8b7fd4c9a8fdbc099fa29e52ba8dfaa6c002db0d13c980"}
May 28 10:05:20.821456 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.821403    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f46zp" event={"ID":"6b2ce129-fabb-4741-9581-91c7796d802f","Type":"ContainerStarted","Data":"352b29101d3739082e5007314b6be2a27650cd0d031880c70860a857f8eaaa8f"}
May 28 10:05:20.829207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:20.829178    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds" event={"ID":"7a59feb0-2126-414c-b5b1-7faa7a855785","Type":"ContainerStarted","Data":"c54fd6f884dbef1adb52dc16431997854069921a8042d27fa26574209034a044"}
May 28 10:05:21.329056 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:21.328497    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:21.329056 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.328677    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:21.329056 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.328740    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:23.328721966 +0000 UTC m=+6.222290222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:21.429724 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:21.429089    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:21.429724 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.429253    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:21.429724 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.429276    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:21.429724 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.429289    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:21.429724 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.429349    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:23.429331655 +0000 UTC m=+6.322899920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:21.699886 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:21.699807    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:21.700357 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:21.699953    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:21.852336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:21.852302    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal" event={"ID":"63f91d1c882e3bbcd9e885361169af02","Type":"ContainerStarted","Data":"55cdd4e859fb45402a60533d5f41e0ef3bccddb13d6d65ba19bdae2544fc9a8c"}
May 28 10:05:21.868304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:21.868242    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-103.ec2.internal" podStartSLOduration=3.868222431 podStartE2EDuration="3.868222431s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:20.786130541 +0000 UTC m=+3.679698812" watchObservedRunningTime="2026-05-28 10:05:21.868222431 +0000 UTC m=+4.761790692"
May 28 10:05:22.697230 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:22.697194    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:22.697398 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:22.697330    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:23.347034 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:23.346300    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:23.347034 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.346458    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:23.347034 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.346525    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:27.346506872 +0000 UTC m=+10.240075139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:23.446917 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:23.446880    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:23.447100 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.447061    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:23.447100 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.447083    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:23.447100 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.447097    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:23.447225 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.447161    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:27.447142617 +0000 UTC m=+10.340710888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:23.696881 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:23.696803    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:23.697057 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:23.696945    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:24.698272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:24.697804    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:24.698272 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:24.697917    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:25.697959 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:25.697866    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:25.698137 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:25.698037    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:26.697773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:26.697741    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:26.698247 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:26.697875    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:27.381349 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:27.380774    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:27.381349 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.380925    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:27.381349 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.380989    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:35.380970834 +0000 UTC m=+18.274539096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:27.481690 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:27.481642    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:27.481856 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.481840    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:27.481907 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.481867    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:27.481907 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.481881    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:27.481995 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.481958    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:35.481936412 +0000 UTC m=+18.375504684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:27.698082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:27.697833    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:27.698082 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:27.698040    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:28.697622 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:28.697586    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:28.697783 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:28.697716    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:29.697421 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:29.697383    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:29.697898 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:29.697520    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:30.697600 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:30.697557    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:30.698072 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:30.697708    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:31.701949 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:31.701921    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:31.702369 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:31.702051    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:32.696762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:32.696728    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:32.696954 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:32.696852    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:33.700374 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:33.700345    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:33.700778 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:33.700449    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:34.697017 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:34.696984    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:34.697240 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:34.697109    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:35.438647 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:35.438613    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:35.439116 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.438789    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:35.439116 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.438856    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.438840358 +0000 UTC m=+34.332408607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:35.539164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:35.539126    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:35.539355 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.539312    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:35.539355 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.539337    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:35.539355 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.539351    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:35.539510 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.539417    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.539401253 +0000 UTC m=+34.432969501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:35.697309 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:35.697221    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:35.697469 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:35.697369    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:36.697380 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:36.697345    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:36.697854 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:36.697453    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:37.697731 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:37.697616    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:37.698162 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:37.697781    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:38.698046 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.697757    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:38.698735 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:38.698137    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:38.884372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.884338    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"69397b6b62ee5d233e94ebb5c8f90c1054025d25159591987c5b0c7596a2e436"}
May 28 10:05:38.884535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.884382    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"25d92e86937e8d4e23e0b59ea757305bf5a1c2c53a4524385b4616abd7c26ea1"}
May 28 10:05:38.884535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.884398    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"63d3764f17a9554b0948049515c02d90d1ae190b6004fd69b640a96e28f6a952"}
May 28 10:05:38.884535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.884412    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"d0d8aee095cf18776de8ed057d464967270988802658380d53ec39daa37b9374"}
May 28 10:05:38.885548 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.885522    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="8bee7ec5abe9c816122776db7c50c63cc84d33319b8b69858826b56b4a74c189" exitCode=0
May 28 10:05:38.885658 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.885612    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"8bee7ec5abe9c816122776db7c50c63cc84d33319b8b69858826b56b4a74c189"}
May 28 10:05:38.887080 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.886972    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4zfwm" event={"ID":"1dd7b734-bcae-41f2-82cb-3f86e58e8e72","Type":"ContainerStarted","Data":"959d658e909266ada22156392bd6db57f884833e8a2d0d07e6f28b2d57c1f431"}
May 28 10:05:38.888278 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.888256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k8wgv" event={"ID":"2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73","Type":"ContainerStarted","Data":"a77ae232587362a9073f437e503f5bf8f9e5e5672c21bb150cba777395a7d966"}
May 28 10:05:38.889645 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.889617    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f46zp" event={"ID":"6b2ce129-fabb-4741-9581-91c7796d802f","Type":"ContainerStarted","Data":"be8c0db1c9a164a4046d71ebd0bfd043cd80e6e1725d361f5f24a70cb62a93cb"}
May 28 10:05:38.890867 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.890845    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds" event={"ID":"7a59feb0-2126-414c-b5b1-7faa7a855785","Type":"ContainerStarted","Data":"03f077fdf1f2a1491b315fe21ffc2ddb14d5a56ae1d1298eaed93b020b2754c3"}
May 28 10:05:38.892084 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.892063    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hmlwc" event={"ID":"5a56e86f-ebb8-42d1-89fe-28860f216bf1","Type":"ContainerStarted","Data":"07d866a9b4862f807d9218eda3105aebd660b7e24d493b73fb887fe2794f86f4"}
May 28 10:05:38.893298 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.893278    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c7hrj" event={"ID":"a84a19c4-fc9a-43b1-b80b-de995de2bfc9","Type":"ContainerStarted","Data":"92666f25065f05a47c5986001178da9dad7b70b7a20871c9fef6d4778d22839f"}
May 28 10:05:38.894595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.894578    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:38.895109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.895094    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:38.929420 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.929376    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-103.ec2.internal" podStartSLOduration=20.92936128 podStartE2EDuration="20.92936128s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:21.86958236 +0000 UTC m=+4.763150625" watchObservedRunningTime="2026-05-28 10:05:38.92936128 +0000 UTC m=+21.822929549"
May 28 10:05:38.960835 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.960787    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4zfwm" podStartSLOduration=3.926670302 podStartE2EDuration="21.960772127s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.24977287 +0000 UTC m=+3.143341117" lastFinishedPulling="2026-05-28 10:05:38.283874679 +0000 UTC m=+21.177442942" observedRunningTime="2026-05-28 10:05:38.95938527 +0000 UTC m=+21.852953540" watchObservedRunningTime="2026-05-28 10:05:38.960772127 +0000 UTC m=+21.854340396"
May 28 10:05:38.987862 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:38.987813    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hmlwc" podStartSLOduration=4.020933666 podStartE2EDuration="21.987794866s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.245533111 +0000 UTC m=+3.139101362" lastFinishedPulling="2026-05-28 10:05:38.212394299 +0000 UTC m=+21.105962562" observedRunningTime="2026-05-28 10:05:38.987592888 +0000 UTC m=+21.881161172" watchObservedRunningTime="2026-05-28 10:05:38.987794866 +0000 UTC m=+21.881363138"
May 28 10:05:39.049802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.049750    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-f46zp" podStartSLOduration=4.008783818 podStartE2EDuration="22.049733459s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.245496759 +0000 UTC m=+3.139065007" lastFinishedPulling="2026-05-28 10:05:38.286446393 +0000 UTC m=+21.180014648" observedRunningTime="2026-05-28 10:05:39.015555346 +0000 UTC m=+21.909123616" watchObservedRunningTime="2026-05-28 10:05:39.049733459 +0000 UTC m=+21.943301732"
May 28 10:05:39.067846 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.067754    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-k8wgv" podStartSLOduration=3.031084192 podStartE2EDuration="21.06773606s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.249792633 +0000 UTC m=+3.143360880" lastFinishedPulling="2026-05-28 10:05:38.286444501 +0000 UTC m=+21.180012748" observedRunningTime="2026-05-28 10:05:39.049136351 +0000 UTC m=+21.942704623" watchObservedRunningTime="2026-05-28 10:05:39.06773606 +0000 UTC m=+21.961304329"
May 28 10:05:39.068420 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.068390    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c7hrj" podStartSLOduration=4.080390238 podStartE2EDuration="22.068380487s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.224484713 +0000 UTC m=+3.118052960" lastFinishedPulling="2026-05-28 10:05:38.212474961 +0000 UTC m=+21.106043209" observedRunningTime="2026-05-28 10:05:39.067703567 +0000 UTC m=+21.961271838" watchObservedRunningTime="2026-05-28 10:05:39.068380487 +0000 UTC m=+21.961948757"
May 28 10:05:39.676383 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.676153    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 10:05:39.678461 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.678295    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T10:05:39.676337484Z","UUID":"eeb4e239-4b3a-4a1b-85da-3f02d837e171","Handler":null,"Name":"","Endpoint":""}
May 28 10:05:39.681656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.681628    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 10:05:39.681813 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.681664    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 10:05:39.697579 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.697544    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:39.697768 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:39.697688    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:39.897568 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.897527    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds" event={"ID":"7a59feb0-2126-414c-b5b1-7faa7a855785","Type":"ContainerStarted","Data":"b4728e5169b792e5e20fc9ec83882a771ab72d6c1e74c3f2c392012d3a526625"}
May 28 10:05:39.899345 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.899312    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8fb22" event={"ID":"52bb2718-46bb-495e-a103-52fa11211d97","Type":"ContainerStarted","Data":"0e37266c40b43fe641e83efbfb7cec2ec30c29bca7e2a3e2e4cfcd5279c08448"}
May 28 10:05:39.902348 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.902310    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"caeed2c0d6378df6246f8971b8e130bfe7467ed8bfb7eb7410e06f17467b9dbf"}
May 28 10:05:39.902495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.902350    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"65c983eaf9641e7b129492a8cc4b2b0fa57a3d1cfa5fea2ca368e78c8753cf2c"}
May 28 10:05:39.903204 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.903094    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:39.903543 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.903524    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hmlwc"
May 28 10:05:39.931136 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:39.931076    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8fb22" podStartSLOduration=4.886739265 podStartE2EDuration="22.931057713s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.245532564 +0000 UTC m=+3.139100813" lastFinishedPulling="2026-05-28 10:05:38.289851013 +0000 UTC m=+21.183419261" observedRunningTime="2026-05-28 10:05:39.930721985 +0000 UTC m=+22.824290257" watchObservedRunningTime="2026-05-28 10:05:39.931057713 +0000 UTC m=+22.824625996"
May 28 10:05:40.697462 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:40.697422    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:40.697651 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:40.697563    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:41.697176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:41.697139    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:41.697722 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:41.697288    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:41.910748 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:41.910710    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"f9371416499850da77d0c1426670361550cc70b110f6e0f8dd716f53b6138c77"}
May 28 10:05:41.912697 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:41.912665    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds" event={"ID":"7a59feb0-2126-414c-b5b1-7faa7a855785","Type":"ContainerStarted","Data":"8b05f72b74fdacac52d6251c605057ebe5350827cdc7064480b4ac8135148c51"}
May 28 10:05:42.697175 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:42.697132    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:42.697371 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:42.697255    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:43.697490 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.697302    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:43.698031 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:43.697575    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:43.918644 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.918612    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" event={"ID":"e32fb6e9-90d6-48ec-8859-bbea1670da36","Type":"ContainerStarted","Data":"cbccd5da55778b6af5e9f21156f02f9fe766652faac2d28d0937fb17fcbe24cb"}
May 28 10:05:43.919051 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.918986    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:43.920409 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.920386    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="5f7727105e19d2becad6db5e890593b38d287c4a067b0c6d377e6b088af820bb" exitCode=0
May 28 10:05:43.920540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.920423    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"5f7727105e19d2becad6db5e890593b38d287c4a067b0c6d377e6b088af820bb"}
May 28 10:05:43.935835 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.935807    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:43.965159 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.965111    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c" podStartSLOduration=8.762258754 podStartE2EDuration="26.965096805s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.221616383 +0000 UTC m=+3.115184635" lastFinishedPulling="2026-05-28 10:05:38.424454425 +0000 UTC m=+21.318022686" observedRunningTime="2026-05-28 10:05:43.964049201 +0000 UTC m=+26.857617471" watchObservedRunningTime="2026-05-28 10:05:43.965096805 +0000 UTC m=+26.858665075"
May 28 10:05:43.965581 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:43.965560    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t6gds" podStartSLOduration=6.342850121 podStartE2EDuration="26.965555048s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.220117521 +0000 UTC m=+3.113685770" lastFinishedPulling="2026-05-28 10:05:40.842822445 +0000 UTC m=+23.736390697" observedRunningTime="2026-05-28 10:05:41.939768539 +0000 UTC m=+24.833336830" watchObservedRunningTime="2026-05-28 10:05:43.965555048 +0000 UTC m=+26.859123317"
May 28 10:05:44.697066 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.697030    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:44.697253 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:44.697134    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:44.924224 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.924124    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="0c14910e8f58a4f059657d7b49eb7286c1c9d98e391a128602a58c6b6a0da671" exitCode=0
May 28 10:05:44.924607 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.924532    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"0c14910e8f58a4f059657d7b49eb7286c1c9d98e391a128602a58c6b6a0da671"}
May 28 10:05:44.925088 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.925065    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:44.925212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.925095    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:44.940467 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:44.940442    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:05:45.208652 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.208440    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqlck"]
May 28 10:05:45.208780 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.208682    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:45.208780 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:45.208767    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:45.212355 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.212333    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhdk7"]
May 28 10:05:45.212470 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.212430    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:45.212517 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:45.212501    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:45.927949 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.927860    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="b4d70ad8df1a3ce66d46e868f9506e1bbd435d13b008c7eae53f95658086fdf1" exitCode=0
May 28 10:05:45.927949 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:45.927925    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"b4d70ad8df1a3ce66d46e868f9506e1bbd435d13b008c7eae53f95658086fdf1"}
May 28 10:05:46.696827 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:46.696794    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:46.697042 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:46.696794    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:46.697042 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:46.696918    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:46.697042 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:46.696988    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:48.697103 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:48.697067    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:48.697777 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:48.697073    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:48.697777 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:48.697198    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:48.697777 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:48.697273    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:50.697537 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:50.697506    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:50.698238 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:50.697506    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:50.698238 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:50.697630    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhdk7" podUID="a0f466b4-f772-4529-abcb-12e086451531"
May 28 10:05:50.698238 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:50.697694    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqlck" podUID="f5465d80-abd4-439f-9ad4-9f8d32139de6"
May 28 10:05:51.464865 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.464838    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:51.465043 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.464956    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:51.465043 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.465002    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs podName:a0f466b4-f772-4529-abcb-12e086451531 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:23.46498866 +0000 UTC m=+66.358556909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs") pod "network-metrics-daemon-zhdk7" (UID: "a0f466b4-f772-4529-abcb-12e086451531") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 10:05:51.565858 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.565830    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:51.566103 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.565944    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 10:05:51.566103 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.565956    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 10:05:51.566103 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.565965    2556 projected.go:194] Error preparing data for projected volume kube-api-access-fgjqx for pod openshift-network-diagnostics/network-check-target-gqlck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:51.566103 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:51.566035    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx podName:f5465d80-abd4-439f-9ad4-9f8d32139de6 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:23.565999983 +0000 UTC m=+66.459568232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgjqx" (UniqueName: "kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx") pod "network-check-target-gqlck" (UID: "f5465d80-abd4-439f-9ad4-9f8d32139de6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 10:05:51.940892 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.940722    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="2d7c390eeee480d9da799ebf98d48984a0e23971bbee735dce680b8eb10f565e" exitCode=0
May 28 10:05:51.941242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.940807    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"2d7c390eeee480d9da799ebf98d48984a0e23971bbee735dce680b8eb10f565e"}
May 28 10:05:51.948729 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.948713    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-103.ec2.internal" event="NodeReady"
May 28 10:05:51.948823 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:51.948812    2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 10:05:52.082059 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.082035    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ln6r8"]
May 28 10:05:52.090386 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.090361    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.100494 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.100475    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\""
May 28 10:05:52.100593 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.100514    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 10:05:52.101266 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.101251    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 10:05:52.101351 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.101274    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 10:05:52.102164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.102148    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bgmvg"]
May 28 10:05:52.108838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.108821    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.111458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.111443    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln6r8"]
May 28 10:05:52.111656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.111639    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 10:05:52.111712 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.111674    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 10:05:52.111956 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.111943    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\""
May 28 10:05:52.156966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.156947    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgmvg"]
May 28 10:05:52.171305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.171265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.171437 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.171310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbkp\" (UniqueName: \"kubernetes.io/projected/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-kube-api-access-gnbkp\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.272220 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0bb2541-827b-4d44-8783-2bc1b4530098-config-volume\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.272220 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.272220 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272208    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.272430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2541-827b-4d44-8783-2bc1b4530098-tmp-dir\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.272430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghsw\" (UniqueName: \"kubernetes.io/projected/c0bb2541-827b-4d44-8783-2bc1b4530098-kube-api-access-gghsw\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.272430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.272289    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbkp\" (UniqueName: \"kubernetes.io/projected/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-kube-api-access-gnbkp\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.272430 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.272329    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:52.272430 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.272374    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:05:52.772360724 +0000 UTC m=+35.665928972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:05:52.286962 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.286938    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbkp\" (UniqueName: \"kubernetes.io/projected/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-kube-api-access-gnbkp\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.372881 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.372862    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2541-827b-4d44-8783-2bc1b4530098-tmp-dir\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.372991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.372890    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gghsw\" (UniqueName: \"kubernetes.io/projected/c0bb2541-827b-4d44-8783-2bc1b4530098-kube-api-access-gghsw\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.372991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.372924    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0bb2541-827b-4d44-8783-2bc1b4530098-config-volume\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.372991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.372940    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.373174 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.373032    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:52.373174 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.373074    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:52.873061197 +0000 UTC m=+35.766629445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:05:52.373294 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.373243    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0bb2541-827b-4d44-8783-2bc1b4530098-tmp-dir\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.373469 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.373450    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0bb2541-827b-4d44-8783-2bc1b4530098-config-volume\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.394889 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.394866    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghsw\" (UniqueName: \"kubernetes.io/projected/c0bb2541-827b-4d44-8783-2bc1b4530098-kube-api-access-gghsw\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.697099 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.697021    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:05:52.697235 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.697024    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:05:52.700118 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.700101    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\""
May 28 10:05:52.700118 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.700117    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 10:05:52.700329 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.700316    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 10:05:52.700509 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.700494    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\""
May 28 10:05:52.701183 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.701168    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 10:05:52.775234 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.775216    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:52.775320 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.775294    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:52.775359 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.775340    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:05:53.775326496 +0000 UTC m=+36.668894744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:05:52.875464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.875445    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:52.875540 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.875525    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:52.875576 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:52.875564    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:53.875553604 +0000 UTC m=+36.769121852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:05:52.944779 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.944755    2556 generic.go:358] "Generic (PLEG): container finished" podID="76df4a2b-f318-46f4-9977-4ec3d2fd4cf5" containerID="10542522514d64db25da1c793aaa6f2080122821ad6f470a965a8d9df41ba29c" exitCode=0
May 28 10:05:52.945055 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:52.944807    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerDied","Data":"10542522514d64db25da1c793aaa6f2080122821ad6f470a965a8d9df41ba29c"}
May 28 10:05:53.780204 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:53.780171    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:53.780359 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:53.780305    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:53.780403 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:53.780378    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:05:55.780362063 +0000 UTC m=+38.673930311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:05:53.880722 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:53.880693    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:53.880861 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:53.880842    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:53.880911 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:53.880901    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:55.880884064 +0000 UTC m=+38.774452337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:05:53.951898 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:53.951860    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" event={"ID":"76df4a2b-f318-46f4-9977-4ec3d2fd4cf5","Type":"ContainerStarted","Data":"a49a7cf8d0fe63f3b122edd122f3fe424fa61016209b9a8bfdea3d12b5d3b861"}
May 28 10:05:53.980766 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:53.980718    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dmpj4" podStartSLOduration=4.585960808 podStartE2EDuration="35.980706556s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:20.219247238 +0000 UTC m=+3.112815493" lastFinishedPulling="2026-05-28 10:05:51.613992989 +0000 UTC m=+34.507561241" observedRunningTime="2026-05-28 10:05:53.980226621 +0000 UTC m=+36.873794895" watchObservedRunningTime="2026-05-28 10:05:53.980706556 +0000 UTC m=+36.874274825"
May 28 10:05:55.793228 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:55.793199    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:55.793615 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:55.793331    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:55.793615 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:55.793389    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.79337613 +0000 UTC m=+42.686944383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:05:55.894029 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:55.893992    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:55.894159 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:55.894089    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:55.894159 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:55.894140    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.894127241 +0000 UTC m=+42.787695490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:05:59.821679 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:59.821646    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:05:59.822086 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:59.821784    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:05:59.822086 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:59.821843    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:06:07.821827741 +0000 UTC m=+50.715395989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:05:59.922875 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:05:59.922850    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:05:59.923054 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:59.922999    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:05:59.923137 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:05:59.923087    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:07.923072161 +0000 UTC m=+50.816640409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:06:01.781564 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.781530    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"]
May 28 10:06:01.807663 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.807635    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"]
May 28 10:06:01.807814 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.807766    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"
May 28 10:06:01.810919 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.810896    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 10:06:01.811048 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.810896    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7865q\""
May 28 10:06:01.811701 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.811688    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 10:06:01.934378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:01.934347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzclk\" (UniqueName: \"kubernetes.io/projected/bc948a44-2d68-4230-9096-b0bf956d8072-kube-api-access-hzclk\") pod \"migrator-b985f5d89-c9cht\" (UID: \"bc948a44-2d68-4230-9096-b0bf956d8072\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"
May 28 10:06:02.035321 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.035239    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzclk\" (UniqueName: \"kubernetes.io/projected/bc948a44-2d68-4230-9096-b0bf956d8072-kube-api-access-hzclk\") pod \"migrator-b985f5d89-c9cht\" (UID: \"bc948a44-2d68-4230-9096-b0bf956d8072\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"
May 28 10:06:02.048654 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.048620    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzclk\" (UniqueName: \"kubernetes.io/projected/bc948a44-2d68-4230-9096-b0bf956d8072-kube-api-access-hzclk\") pod \"migrator-b985f5d89-c9cht\" (UID: \"bc948a44-2d68-4230-9096-b0bf956d8072\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"
May 28 10:06:02.116832 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.116797    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"
May 28 10:06:02.295042 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.294954    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht"]
May 28 10:06:02.299790 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:02.299752    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc948a44_2d68_4230_9096_b0bf956d8072.slice/crio-573ab4f1c731c49707f41f6b2598258104146c7454a61664f76ed563d0b59721 WatchSource:0}: Error finding container 573ab4f1c731c49707f41f6b2598258104146c7454a61664f76ed563d0b59721: Status 404 returned error can't find the container with id 573ab4f1c731c49707f41f6b2598258104146c7454a61664f76ed563d0b59721
May 28 10:06:02.338833 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.338812    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f46zp_6b2ce129-fabb-4741-9581-91c7796d802f/dns-node-resolver/0.log"
May 28 10:06:02.821740 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.821713    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6xgvx"]
May 28 10:06:02.842585 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.842560    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6xgvx"]
May 28 10:06:02.842738 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.842723    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:02.846614 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.846591    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 10:06:02.846728 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.846641    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 10:06:02.846728 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.846596    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 10:06:02.847787 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.847771    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4hb9h\""
May 28 10:06:02.847834 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.847806    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 10:06:02.941832 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.941809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-key\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:02.941966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.941859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-cabundle\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:02.941966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.941881    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dthwx\" (UniqueName: \"kubernetes.io/projected/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-kube-api-access-dthwx\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:02.966199 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:02.966167    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht" event={"ID":"bc948a44-2d68-4230-9096-b0bf956d8072","Type":"ContainerStarted","Data":"573ab4f1c731c49707f41f6b2598258104146c7454a61664f76ed563d0b59721"}
May 28 10:06:03.042670 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.042644    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-cabundle\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.042773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.042675    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dthwx\" (UniqueName: \"kubernetes.io/projected/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-kube-api-access-dthwx\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.042773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.042720    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-key\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.043301 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.043280    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-cabundle\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.045094 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.045077    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-signing-key\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.052948 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.052925    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dthwx\" (UniqueName: \"kubernetes.io/projected/11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc-kube-api-access-dthwx\") pod \"service-ca-67d667c7d-6xgvx\" (UID: \"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc\") " pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.151514 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.151453    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-6xgvx"
May 28 10:06:03.294504 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.294472    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6xgvx"]
May 28 10:06:03.297913 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:03.297881    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11aa8c17_2fbb_466d_bbb8_a9a28d5a9efc.slice/crio-966cd41c66efdd31f8bd926ced1f18e18075605c27ce31ef63a8ed12c05af38d WatchSource:0}: Error finding container 966cd41c66efdd31f8bd926ced1f18e18075605c27ce31ef63a8ed12c05af38d: Status 404 returned error can't find the container with id 966cd41c66efdd31f8bd926ced1f18e18075605c27ce31ef63a8ed12c05af38d
May 28 10:06:03.342233 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.342208    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c7hrj_a84a19c4-fc9a-43b1-b80b-de995de2bfc9/node-ca/0.log"
May 28 10:06:03.969061 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:03.969020    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-6xgvx" event={"ID":"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc","Type":"ContainerStarted","Data":"966cd41c66efdd31f8bd926ced1f18e18075605c27ce31ef63a8ed12c05af38d"}
May 28 10:06:04.972467 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:04.972426    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht" event={"ID":"bc948a44-2d68-4230-9096-b0bf956d8072","Type":"ContainerStarted","Data":"56aaf4823f92281a2b5edd7e9323bbf466b84092602a479e9c729b26ed5d4175"}
May 28 10:06:04.972840 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:04.972476    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht" event={"ID":"bc948a44-2d68-4230-9096-b0bf956d8072","Type":"ContainerStarted","Data":"a406bd670127a5aafad0e40eaea398e4f74fe4afdc91e1a8cc9e950044afec9a"}
May 28 10:06:04.993459 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:04.993409    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-c9cht" podStartSLOduration=2.031089582 podStartE2EDuration="3.993392801s" podCreationTimestamp="2026-05-28 10:06:01 +0000 UTC" firstStartedPulling="2026-05-28 10:06:02.301606878 +0000 UTC m=+45.195175125" lastFinishedPulling="2026-05-28 10:06:04.263910094 +0000 UTC m=+47.157478344" observedRunningTime="2026-05-28 10:06:04.992286502 +0000 UTC m=+47.885854784" watchObservedRunningTime="2026-05-28 10:06:04.993392801 +0000 UTC m=+47.886961068"
May 28 10:06:05.975590 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:05.975550    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-6xgvx" event={"ID":"11aa8c17-2fbb-466d-bbb8-a9a28d5a9efc","Type":"ContainerStarted","Data":"76910a86b4a68692aa2bd48bc25e2cafe0bbca0e38b03349348eb598fcd23cd7"}
May 28 10:06:05.994936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:05.994878    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-6xgvx" podStartSLOduration=1.591561962 podStartE2EDuration="3.994861838s" podCreationTimestamp="2026-05-28 10:06:02 +0000 UTC" firstStartedPulling="2026-05-28 10:06:03.300078438 +0000 UTC m=+46.193646689" lastFinishedPulling="2026-05-28 10:06:05.703378303 +0000 UTC m=+48.596946565" observedRunningTime="2026-05-28 10:06:05.993779124 +0000 UTC m=+48.887347393" watchObservedRunningTime="2026-05-28 10:06:05.994861838 +0000 UTC m=+48.888430108"
May 28 10:06:07.881404 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:07.881360    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:06:07.881874 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:07.881485    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 10:06:07.881874 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:07.881545    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert podName:0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa nodeName:}" failed. No retries permitted until 2026-05-28 10:06:23.881530767 +0000 UTC m=+66.775099015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert") pod "ingress-canary-ln6r8" (UID: "0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa") : secret "canary-serving-cert" not found
May 28 10:06:07.982242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:07.982206    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:07.982397 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:07.982346    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 10:06:07.982459 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:07.982448    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls podName:c0bb2541-827b-4d44-8783-2bc1b4530098 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:23.982433313 +0000 UTC m=+66.876001566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls") pod "dns-default-bgmvg" (UID: "c0bb2541-827b-4d44-8783-2bc1b4530098") : secret "dns-default-metrics-tls" not found
May 28 10:06:16.940492 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:16.940464    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmh9c"
May 28 10:06:23.489442 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.489392    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:06:23.492256 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.492238    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 10:06:23.502797 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.502772    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0f466b4-f772-4529-abcb-12e086451531-metrics-certs\") pod \"network-metrics-daemon-zhdk7\" (UID: \"a0f466b4-f772-4529-abcb-12e086451531\") " pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:06:23.590501 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.590462    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:06:23.593155 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.593134    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 10:06:23.604076 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.604042    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 10:06:23.612459 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.612426    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\""
May 28 10:06:23.614664 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.614637    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjqx\" (UniqueName: \"kubernetes.io/projected/f5465d80-abd4-439f-9ad4-9f8d32139de6-kube-api-access-fgjqx\") pod \"network-check-target-gqlck\" (UID: \"f5465d80-abd4-439f-9ad4-9f8d32139de6\") " pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:06:23.620542 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.620515    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhdk7"
May 28 10:06:23.751851 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.751756    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhdk7"]
May 28 10:06:23.755891 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:23.755857    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f466b4_f772_4529_abcb_12e086451531.slice/crio-536934eab15c267b22ce79a244281aab901de2a506b5d7cdd22af570c8bbbf79 WatchSource:0}: Error finding container 536934eab15c267b22ce79a244281aab901de2a506b5d7cdd22af570c8bbbf79: Status 404 returned error can't find the container with id 536934eab15c267b22ce79a244281aab901de2a506b5d7cdd22af570c8bbbf79
May 28 10:06:23.892685 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.892642    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:06:23.895127 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.895091    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa-cert\") pod \"ingress-canary-ln6r8\" (UID: \"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa\") " pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:06:23.901933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.901912    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\""
May 28 10:06:23.908825 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.908799    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\""
May 28 10:06:23.908999 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.908986    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln6r8"
May 28 10:06:23.916212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.916183    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:06:23.994174 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.993789    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:23.996740 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:23.996700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0bb2541-827b-4d44-8783-2bc1b4530098-metrics-tls\") pod \"dns-default-bgmvg\" (UID: \"c0bb2541-827b-4d44-8783-2bc1b4530098\") " pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:24.015264 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.015226    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhdk7" event={"ID":"a0f466b4-f772-4529-abcb-12e086451531","Type":"ContainerStarted","Data":"536934eab15c267b22ce79a244281aab901de2a506b5d7cdd22af570c8bbbf79"}
May 28 10:06:24.050487 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.050455    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln6r8"]
May 28 10:06:24.055184 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:24.055153    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b114e3b_8acb_4eb3_be78_abb4f7a4ecaa.slice/crio-85f3921b3d8044134ec6b9990514b20324a89204aa65a7f61d9603974b7041f9 WatchSource:0}: Error finding container 85f3921b3d8044134ec6b9990514b20324a89204aa65a7f61d9603974b7041f9: Status 404 returned error can't find the container with id 85f3921b3d8044134ec6b9990514b20324a89204aa65a7f61d9603974b7041f9
May 28 10:06:24.063279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.063249    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqlck"]
May 28 10:06:24.066361 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:24.066330    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5465d80_abd4_439f_9ad4_9f8d32139de6.slice/crio-84cd54e18bebb58468fbcea34cfd27d4b52dcc713d49743d9757df3a0397636d WatchSource:0}: Error finding container 84cd54e18bebb58468fbcea34cfd27d4b52dcc713d49743d9757df3a0397636d: Status 404 returned error can't find the container with id 84cd54e18bebb58468fbcea34cfd27d4b52dcc713d49743d9757df3a0397636d
May 28 10:06:24.259444 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.259359    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\""
May 28 10:06:24.266571 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.266545    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:24.407480 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:24.407445    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgmvg"]
May 28 10:06:24.411217 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:24.411177    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bb2541_827b_4d44_8783_2bc1b4530098.slice/crio-9e7a02083a2a8c82d185cdbb8dcf1f81a60db1ac0bb4831fcc608878296c32cc WatchSource:0}: Error finding container 9e7a02083a2a8c82d185cdbb8dcf1f81a60db1ac0bb4831fcc608878296c32cc: Status 404 returned error can't find the container with id 9e7a02083a2a8c82d185cdbb8dcf1f81a60db1ac0bb4831fcc608878296c32cc
May 28 10:06:25.018882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:25.018816    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqlck" event={"ID":"f5465d80-abd4-439f-9ad4-9f8d32139de6","Type":"ContainerStarted","Data":"84cd54e18bebb58468fbcea34cfd27d4b52dcc713d49743d9757df3a0397636d"}
May 28 10:06:25.020327 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:25.020293    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln6r8" event={"ID":"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa","Type":"ContainerStarted","Data":"85f3921b3d8044134ec6b9990514b20324a89204aa65a7f61d9603974b7041f9"}
May 28 10:06:25.021691 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:25.021655    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgmvg" event={"ID":"c0bb2541-827b-4d44-8783-2bc1b4530098","Type":"ContainerStarted","Data":"9e7a02083a2a8c82d185cdbb8dcf1f81a60db1ac0bb4831fcc608878296c32cc"}
May 28 10:06:26.025609 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.025568    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhdk7" event={"ID":"a0f466b4-f772-4529-abcb-12e086451531","Type":"ContainerStarted","Data":"f365268db6b03715a128cefefb553fcb92f5cb01d20bdca458e29c881793c189"}
May 28 10:06:26.025609 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.025611    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhdk7" event={"ID":"a0f466b4-f772-4529-abcb-12e086451531","Type":"ContainerStarted","Data":"74d8e3f5a932b888d5a18ec89468ba9ff144507c0bbc20a8f879ec228abe5622"}
May 28 10:06:26.081652 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.081574    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zhdk7" podStartSLOduration=67.804465672 podStartE2EDuration="1m9.081553359s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:06:23.757937168 +0000 UTC m=+66.651505416" lastFinishedPulling="2026-05-28 10:06:25.035024841 +0000 UTC m=+67.928593103" observedRunningTime="2026-05-28 10:06:26.081117318 +0000 UTC m=+68.974685588" watchObservedRunningTime="2026-05-28 10:06:26.081553359 +0000 UTC m=+68.975121630"
May 28 10:06:26.184428 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.184396    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"]
May 28 10:06:26.187644 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.187615    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:26.190429 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.190402    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qvj5x\""
May 28 10:06:26.190565 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.190511    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 10:06:26.208026 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.207962    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"]
May 28 10:06:26.209245 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.209219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0463b172-1a5b-4e36-a6cf-8e04218372e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7qr45\" (UID: \"0463b172-1a5b-4e36-a6cf-8e04218372e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:26.286893 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.286797    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-5bfkb"]
May 28 10:06:26.289788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.289756    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:26.290875 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.290855    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-559b4dc97d-4tkvj"]
May 28 10:06:26.293450 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.293433    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.300570 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.300545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bh8qd\""
May 28 10:06:26.300677 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.300593    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 10:06:26.301943 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.301923    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 10:06:26.302073 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.301987    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 10:06:26.302272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.302256    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9brr7\""
May 28 10:06:26.302646 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.302626    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 10:06:26.303815 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.303801    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 10:06:26.308276 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.308251    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 10:06:26.309695 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-bound-sa-token\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.309802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-tls\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.309802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309752    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0463b172-1a5b-4e36-a6cf-8e04218372e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7qr45\" (UID: \"0463b172-1a5b-4e36-a6cf-8e04218372e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:26.309802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9jk5\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-kube-api-access-n9jk5\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.309802 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-image-registry-private-configuration\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.310031 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02c44456-a0dc-4b39-98d8-fa737c0e47b8-ca-trust-extracted\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.310031 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q86hk\" (UniqueName: \"kubernetes.io/projected/2c87ea24-5c59-4e28-9dc5-a81ec7f670db-kube-api-access-q86hk\") pod \"downloads-57bd96b888-5bfkb\" (UID: \"2c87ea24-5c59-4e28-9dc5-a81ec7f670db\") " pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:26.310031 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-certificates\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.310031 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309970    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-trusted-ca\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.310031 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.309994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-installation-pull-secrets\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.312751 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.312717    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0463b172-1a5b-4e36-a6cf-8e04218372e6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7qr45\" (UID: \"0463b172-1a5b-4e36-a6cf-8e04218372e6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:26.314109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.314088    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-5bfkb"]
May 28 10:06:26.326017 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.325970    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559b4dc97d-4tkvj"]
May 28 10:06:26.340664 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.340632    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hxbg5"]
May 28 10:06:26.343931 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.343912    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.347112 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.347089    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zl88p\""
May 28 10:06:26.360680 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.360647    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 10:06:26.360680 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.360666    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 10:06:26.360855 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.360729    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 10:06:26.360855 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.360666    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 10:06:26.393631 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.393581    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxbg5"]
May 28 10:06:26.410600 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410567    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-image-registry-private-configuration\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.410773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410613    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02c44456-a0dc-4b39-98d8-fa737c0e47b8-ca-trust-extracted\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.410773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4s66\" (UniqueName: \"kubernetes.io/projected/9a84a60e-edfe-4767-849f-54810807652e-kube-api-access-d4s66\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.410773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a84a60e-edfe-4767-849f-54810807652e-data-volume\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.410773 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410742    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q86hk\" (UniqueName: \"kubernetes.io/projected/2c87ea24-5c59-4e28-9dc5-a81ec7f670db-kube-api-access-q86hk\") pod \"downloads-57bd96b888-5bfkb\" (UID: \"2c87ea24-5c59-4e28-9dc5-a81ec7f670db\") " pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:26.410990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410777    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-certificates\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.410990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410801    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-trusted-ca\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.410990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410827    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-installation-pull-secrets\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.411160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.410986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a84a60e-edfe-4767-849f-54810807652e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.411160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a84a60e-edfe-4767-849f-54810807652e-crio-socket\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.411160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411101    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-bound-sa-token\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.411160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411137    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-tls\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.411160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411139    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02c44456-a0dc-4b39-98d8-fa737c0e47b8-ca-trust-extracted\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.411391 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411199    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a84a60e-edfe-4767-849f-54810807652e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.411391 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.411245    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9jk5\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-kube-api-access-n9jk5\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.413169 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.412252    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-certificates\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.413169 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.412803    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c44456-a0dc-4b39-98d8-fa737c0e47b8-trusted-ca\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.415046 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.413640    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-installation-pull-secrets\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.415046 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.413744    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02c44456-a0dc-4b39-98d8-fa737c0e47b8-image-registry-private-configuration\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.416743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.416721    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-registry-tls\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.450048 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.449992    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q86hk\" (UniqueName: \"kubernetes.io/projected/2c87ea24-5c59-4e28-9dc5-a81ec7f670db-kube-api-access-q86hk\") pod \"downloads-57bd96b888-5bfkb\" (UID: \"2c87ea24-5c59-4e28-9dc5-a81ec7f670db\") " pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:26.466575 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.466540    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-bound-sa-token\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.471121 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.471090    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9jk5\" (UniqueName: \"kubernetes.io/projected/02c44456-a0dc-4b39-98d8-fa737c0e47b8-kube-api-access-n9jk5\") pod \"image-registry-559b4dc97d-4tkvj\" (UID: \"02c44456-a0dc-4b39-98d8-fa737c0e47b8\") " pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.497260 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.497224    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:26.511732 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511685    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a84a60e-edfe-4767-849f-54810807652e-data-volume\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.511909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511763    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a84a60e-edfe-4767-849f-54810807652e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.511909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511800    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a84a60e-edfe-4767-849f-54810807652e-crio-socket\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.511909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511859    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a84a60e-edfe-4767-849f-54810807652e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.511909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511904    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4s66\" (UniqueName: \"kubernetes.io/projected/9a84a60e-edfe-4767-849f-54810807652e-kube-api-access-d4s66\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.512156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.511977    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a84a60e-edfe-4767-849f-54810807652e-crio-socket\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.512156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.512124    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a84a60e-edfe-4767-849f-54810807652e-data-volume\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.512412 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.512385    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a84a60e-edfe-4767-849f-54810807652e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.514418 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.514387    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a84a60e-edfe-4767-849f-54810807652e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.536075 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.536039    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4s66\" (UniqueName: \"kubernetes.io/projected/9a84a60e-edfe-4767-849f-54810807652e-kube-api-access-d4s66\") pod \"insights-runtime-extractor-hxbg5\" (UID: \"9a84a60e-edfe-4767-849f-54810807652e\") " pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:26.603066 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.602965    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:26.608897 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.608867    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:26.655855 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:26.655820    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxbg5"
May 28 10:06:27.662885 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:27.662810    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"]
May 28 10:06:27.670244 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:27.670210    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0463b172_1a5b_4e36_a6cf_8e04218372e6.slice/crio-40f26f9a6b891a6ae0665b939750e682bbbfa9f90fa59355d87d293c0a175b54 WatchSource:0}: Error finding container 40f26f9a6b891a6ae0665b939750e682bbbfa9f90fa59355d87d293c0a175b54: Status 404 returned error can't find the container with id 40f26f9a6b891a6ae0665b939750e682bbbfa9f90fa59355d87d293c0a175b54
May 28 10:06:27.887157 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:27.887117    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c87ea24_5c59_4e28_9dc5_a81ec7f670db.slice/crio-ad98919dca669bba44a81e8e7a29ebd3a57de718061400765aaf5d66a6868c64 WatchSource:0}: Error finding container ad98919dca669bba44a81e8e7a29ebd3a57de718061400765aaf5d66a6868c64: Status 404 returned error can't find the container with id ad98919dca669bba44a81e8e7a29ebd3a57de718061400765aaf5d66a6868c64
May 28 10:06:27.888156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:27.888133    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-5bfkb"]
May 28 10:06:27.889579 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:27.889559    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxbg5"]
May 28 10:06:27.890347 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:27.890327    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559b4dc97d-4tkvj"]
May 28 10:06:27.891542 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:27.891524    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a84a60e_edfe_4767_849f_54810807652e.slice/crio-864eb78e3078eced008815f5119a074a84e80c17d8f31767b52fbbc90a1f5f69 WatchSource:0}: Error finding container 864eb78e3078eced008815f5119a074a84e80c17d8f31767b52fbbc90a1f5f69: Status 404 returned error can't find the container with id 864eb78e3078eced008815f5119a074a84e80c17d8f31767b52fbbc90a1f5f69
May 28 10:06:27.892234 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:27.892142    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c44456_a0dc_4b39_98d8_fa737c0e47b8.slice/crio-8abc3b979a4beba467c92647badda041c1ffdfe7746fb0b5f656097c806a0050 WatchSource:0}: Error finding container 8abc3b979a4beba467c92647badda041c1ffdfe7746fb0b5f656097c806a0050: Status 404 returned error can't find the container with id 8abc3b979a4beba467c92647badda041c1ffdfe7746fb0b5f656097c806a0050
May 28 10:06:28.032677 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.032643    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqlck" event={"ID":"f5465d80-abd4-439f-9ad4-9f8d32139de6","Type":"ContainerStarted","Data":"90c89e55c03eca08974d79085f08f81f0ea617f93e7281f5d120731267859423"}
May 28 10:06:28.032877 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.032795    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:06:28.034051 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.034025    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln6r8" event={"ID":"0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa","Type":"ContainerStarted","Data":"553b71891d2f3e75729d683b8ef1114b27d5ee49b756e963d29e79b39288f39c"}
May 28 10:06:28.035218 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.035200    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj" event={"ID":"02c44456-a0dc-4b39-98d8-fa737c0e47b8","Type":"ContainerStarted","Data":"94483687c631d59e54029014f90e5aacdfa3559e3223acbbed8fbf9372e5ab28"}
May 28 10:06:28.035306 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.035223    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj" event={"ID":"02c44456-a0dc-4b39-98d8-fa737c0e47b8","Type":"ContainerStarted","Data":"8abc3b979a4beba467c92647badda041c1ffdfe7746fb0b5f656097c806a0050"}
May 28 10:06:28.035358 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.035331    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:28.036503 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.036476    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxbg5" event={"ID":"9a84a60e-edfe-4767-849f-54810807652e","Type":"ContainerStarted","Data":"6942bcf07463d2e9d1d1e1f291e090d71bfc3749ecb0812df05f2c68d0f7bf82"}
May 28 10:06:28.036576 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.036501    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxbg5" event={"ID":"9a84a60e-edfe-4767-849f-54810807652e","Type":"ContainerStarted","Data":"864eb78e3078eced008815f5119a074a84e80c17d8f31767b52fbbc90a1f5f69"}
May 28 10:06:28.037524 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.037505    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-5bfkb" event={"ID":"2c87ea24-5c59-4e28-9dc5-a81ec7f670db","Type":"ContainerStarted","Data":"ad98919dca669bba44a81e8e7a29ebd3a57de718061400765aaf5d66a6868c64"}
May 28 10:06:28.038530 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.038509    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45" event={"ID":"0463b172-1a5b-4e36-a6cf-8e04218372e6","Type":"ContainerStarted","Data":"40f26f9a6b891a6ae0665b939750e682bbbfa9f90fa59355d87d293c0a175b54"}
May 28 10:06:28.040073 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.040052    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgmvg" event={"ID":"c0bb2541-827b-4d44-8783-2bc1b4530098","Type":"ContainerStarted","Data":"f4838fa4064dacafebf15fac1811ebd2a3b8e63f6e7472cb9c880cf7f1cfd7f7"}
May 28 10:06:28.040157 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.040080    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgmvg" event={"ID":"c0bb2541-827b-4d44-8783-2bc1b4530098","Type":"ContainerStarted","Data":"6eec16fe0328f0e4e9f19577019c98de03e158e317cb8d86f4e50360c54e5f2e"}
May 28 10:06:28.040250 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.040237    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:28.051347 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.051300    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gqlck" podStartSLOduration=67.661633396 podStartE2EDuration="1m11.051285675s" podCreationTimestamp="2026-05-28 10:05:17 +0000 UTC" firstStartedPulling="2026-05-28 10:06:24.068147316 +0000 UTC m=+66.961715563" lastFinishedPulling="2026-05-28 10:06:27.457799583 +0000 UTC m=+70.351367842" observedRunningTime="2026-05-28 10:06:28.050311435 +0000 UTC m=+70.943879708" watchObservedRunningTime="2026-05-28 10:06:28.051285675 +0000 UTC m=+70.944853986"
May 28 10:06:28.080144 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.079531    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj" podStartSLOduration=2.079510694 podStartE2EDuration="2.079510694s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:28.078247662 +0000 UTC m=+70.971815933" watchObservedRunningTime="2026-05-28 10:06:28.079510694 +0000 UTC m=+70.973078959"
May 28 10:06:28.096252 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.096203    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ln6r8" podStartSLOduration=32.701363246 podStartE2EDuration="36.096183911s" podCreationTimestamp="2026-05-28 10:05:52 +0000 UTC" firstStartedPulling="2026-05-28 10:06:24.05711227 +0000 UTC m=+66.950680523" lastFinishedPulling="2026-05-28 10:06:27.451932925 +0000 UTC m=+70.345501188" observedRunningTime="2026-05-28 10:06:28.095979439 +0000 UTC m=+70.989547734" watchObservedRunningTime="2026-05-28 10:06:28.096183911 +0000 UTC m=+70.989752427"
May 28 10:06:28.118451 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:28.118390    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bgmvg" podStartSLOduration=33.077405249 podStartE2EDuration="36.118373173s" podCreationTimestamp="2026-05-28 10:05:52 +0000 UTC" firstStartedPulling="2026-05-28 10:06:24.413261711 +0000 UTC m=+67.306829973" lastFinishedPulling="2026-05-28 10:06:27.454229637 +0000 UTC m=+70.347797897" observedRunningTime="2026-05-28 10:06:28.117615271 +0000 UTC m=+71.011183575" watchObservedRunningTime="2026-05-28 10:06:28.118373173 +0000 UTC m=+71.011941451"
May 28 10:06:29.045611 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:29.045566    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxbg5" event={"ID":"9a84a60e-edfe-4767-849f-54810807652e","Type":"ContainerStarted","Data":"afae65ca12cf698a513944f3800e20bd988861dac3f2ba085175d574c03916a5"}
May 28 10:06:30.053070 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:30.053029    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45" event={"ID":"0463b172-1a5b-4e36-a6cf-8e04218372e6","Type":"ContainerStarted","Data":"09d4193df8166298c368b93d18e86f21c9769af7051484a517394eb2ca9c91fe"}
May 28 10:06:30.053500 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:30.053171    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:30.059398 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:30.059371    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45"
May 28 10:06:30.071966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:30.071905    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7qr45" podStartSLOduration=2.678054903 podStartE2EDuration="4.07188694s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="2026-05-28 10:06:27.672274789 +0000 UTC m=+70.565843041" lastFinishedPulling="2026-05-28 10:06:29.066106818 +0000 UTC m=+71.959675078" observedRunningTime="2026-05-28 10:06:30.071551144 +0000 UTC m=+72.965119418" watchObservedRunningTime="2026-05-28 10:06:30.07188694 +0000 UTC m=+72.965455213"
May 28 10:06:31.058852 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:31.058794    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxbg5" event={"ID":"9a84a60e-edfe-4767-849f-54810807652e","Type":"ContainerStarted","Data":"22d8a0fa8981389183687bc6cd3387480b9af9707ae5326517316830cbdc0a8b"}
May 28 10:06:31.082742 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:31.082675    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hxbg5" podStartSLOduration=3.026914562 podStartE2EDuration="5.082654962s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="2026-05-28 10:06:27.946245487 +0000 UTC m=+70.839813735" lastFinishedPulling="2026-05-28 10:06:30.001985873 +0000 UTC m=+72.895554135" observedRunningTime="2026-05-28 10:06:31.080888347 +0000 UTC m=+73.974456622" watchObservedRunningTime="2026-05-28 10:06:31.082654962 +0000 UTC m=+73.976223233"
May 28 10:06:36.037451 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.035876    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"]
May 28 10:06:36.040151 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.040119    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.046431 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.044677    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 10:06:36.047029 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.046881    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-skn7b\""
May 28 10:06:36.047280 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.047257    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 10:06:36.049592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.047996    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 10:06:36.049592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.048255    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 10:06:36.049592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.048447    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 10:06:36.049592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.048630    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 10:06:36.055140 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.055108    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"]
May 28 10:06:36.058783 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.058749    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8czws"]
May 28 10:06:36.067314 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.067287    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.070239 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.070087    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t9x7r\""
May 28 10:06:36.072062 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.072043    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 10:06:36.072228 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.072209    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 10:06:36.072436 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.072422    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088553    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088593    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088637    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktkg\" (UniqueName: \"kubernetes.io/projected/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-api-access-8ktkg\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.088829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.088689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c578fa14-8f54-425e-a3f6-6a1728496d40-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-wtmp\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-sys\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-accelerators-collector-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-root\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190290    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-metrics-client-ca\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdvg\" (UniqueName: \"kubernetes.io/projected/62f74565-7d8d-4370-8de7-1103edb7e813-kube-api-access-wwdvg\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190463    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190500    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-textfile\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190533    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190562    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktkg\" (UniqueName: \"kubernetes.io/projected/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-api-access-8ktkg\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.190588    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c578fa14-8f54-425e-a3f6-6a1728496d40-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192944 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.191032    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c578fa14-8f54-425e-a3f6-6a1728496d40-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.192944 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.191671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.193743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.193680    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c578fa14-8f54-425e-a3f6-6a1728496d40-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.206449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.197229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.206449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.198480    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.226845 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.226776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktkg\" (UniqueName: \"kubernetes.io/projected/c578fa14-8f54-425e-a3f6-6a1728496d40-kube-api-access-8ktkg\") pod \"kube-state-metrics-54fd6bc5c4-9dldx\" (UID: \"c578fa14-8f54-425e-a3f6-6a1728496d40\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.291987    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-wtmp\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292062    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-sys\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292096    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-accelerators-collector-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292121    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-root\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292151    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292190    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-metrics-client-ca\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292213    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdvg\" (UniqueName: \"kubernetes.io/projected/62f74565-7d8d-4370-8de7-1103edb7e813-kube-api-access-wwdvg\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292243    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292289    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-textfile\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-textfile\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292815    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-wtmp\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.292853    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-sys\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.293434    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-metrics-client-ca\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.293489    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f74565-7d8d-4370-8de7-1103edb7e813-root\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.293788 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:36.293573    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 10:06:36.293788 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:06:36.293649    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls podName:62f74565-7d8d-4370-8de7-1103edb7e813 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:36.793618703 +0000 UTC m=+79.687186962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls") pod "node-exporter-8czws" (UID: "62f74565-7d8d-4370-8de7-1103edb7e813") : secret "node-exporter-tls" not found
May 28 10:06:36.294550 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.294448    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-accelerators-collector-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.297864 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.297837    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.306602 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.306534    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdvg\" (UniqueName: \"kubernetes.io/projected/62f74565-7d8d-4370-8de7-1103edb7e813-kube-api-access-wwdvg\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.371341 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.370880    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"
May 28 10:06:36.558363 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.558024    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx"]
May 28 10:06:36.560892 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:36.560856    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc578fa14_8f54_425e_a3f6_6a1728496d40.slice/crio-25be78767dc3772b6741a7f0d1081437e6358f15a358df46de7fc80699dc7158 WatchSource:0}: Error finding container 25be78767dc3772b6741a7f0d1081437e6358f15a358df46de7fc80699dc7158: Status 404 returned error can't find the container with id 25be78767dc3772b6741a7f0d1081437e6358f15a358df46de7fc80699dc7158
May 28 10:06:36.767028 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.766967    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:06:36.772500 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.772469    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.775025 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.774969    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4585z\""
May 28 10:06:36.775025 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.774996    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 10:06:36.775683 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.775406    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 10:06:36.775683 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.775416    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 10:06:36.775683 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.775417    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 10:06:36.775683 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.775432    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 10:06:36.781097 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.781074    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:06:36.781774 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.781749    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 10:06:36.796925 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.796888    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.799477 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.799449    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f74565-7d8d-4370-8de7-1103edb7e813-node-exporter-tls\") pod \"node-exporter-8czws\" (UID: \"62f74565-7d8d-4370-8de7-1103edb7e813\") " pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.897966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.897880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.897966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.897949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.898207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.897983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx284\" (UniqueName: \"kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.898207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.898018    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.898207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.898041    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.898207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.898105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.898207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.898134    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.984178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.984141    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8czws"
May 28 10:06:36.994178 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:36.994137    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f74565_7d8d_4370_8de7_1103edb7e813.slice/crio-21a0eae74e8259b68263aea63635b3863a50b1ede2b9638dcba65f064aebe639 WatchSource:0}: Error finding container 21a0eae74e8259b68263aea63635b3863a50b1ede2b9638dcba65f064aebe639: Status 404 returned error can't find the container with id 21a0eae74e8259b68263aea63635b3863a50b1ede2b9638dcba65f064aebe639
May 28 10:06:36.998965 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.998942    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999096 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.998991    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vx284\" (UniqueName: \"kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999252 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999223    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999359 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999279    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999359 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999332    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999470 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999376    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:36.999470 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999432    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.000042 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:36.999971    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.000137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.000096    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.000198 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.000145    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.000425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.000366    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.002565 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.002544    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.002706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.002678    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.009050 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.009020    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx284\" (UniqueName: \"kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284\") pod \"console-566ffb9456-6w5rv\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") " pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.080911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.080870    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8czws" event={"ID":"62f74565-7d8d-4370-8de7-1103edb7e813","Type":"ContainerStarted","Data":"21a0eae74e8259b68263aea63635b3863a50b1ede2b9638dcba65f064aebe639"}
May 28 10:06:37.082287 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.082244    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx" event={"ID":"c578fa14-8f54-425e-a3f6-6a1728496d40","Type":"ContainerStarted","Data":"25be78767dc3772b6741a7f0d1081437e6358f15a358df46de7fc80699dc7158"}
May 28 10:06:37.084592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.084550    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:37.257524 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:37.255510    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:06:38.048322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:38.048292    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bgmvg"
May 28 10:06:38.086284 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:38.086246    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566ffb9456-6w5rv" event={"ID":"4a038eeb-e158-41c0-ba95-02a5e12b9c38","Type":"ContainerStarted","Data":"51e7c59e5764dacf46bc43998a5c8673b32000f5f2ed2680ada8d7d7142cc425"}
May 28 10:06:39.093781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.093023    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx" event={"ID":"c578fa14-8f54-425e-a3f6-6a1728496d40","Type":"ContainerStarted","Data":"9f14320948f22fa88f6199864fb2c418762ceae31df1ddb6247bc01d10b8a8d4"}
May 28 10:06:39.093781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.093069    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx" event={"ID":"c578fa14-8f54-425e-a3f6-6a1728496d40","Type":"ContainerStarted","Data":"37c4000c6dadc051dbe7d7b41032d0059e3883e5487006befabcf6ab757b6930"}
May 28 10:06:39.093781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.093083    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx" event={"ID":"c578fa14-8f54-425e-a3f6-6a1728496d40","Type":"ContainerStarted","Data":"2f22dbc35db88a6d4af3f8e584acab480f6ae697473a1a65f048a08688f0ec98"}
May 28 10:06:39.096175 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.096140    2556 generic.go:358] "Generic (PLEG): container finished" podID="62f74565-7d8d-4370-8de7-1103edb7e813" containerID="240ffd59ea54de5c6927e01cdf611ad123065cfb955af5ddb98f535a3f434acb" exitCode=0
May 28 10:06:39.096295 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.096194    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8czws" event={"ID":"62f74565-7d8d-4370-8de7-1103edb7e813","Type":"ContainerDied","Data":"240ffd59ea54de5c6927e01cdf611ad123065cfb955af5ddb98f535a3f434acb"}
May 28 10:06:39.128909 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.128857    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9dldx" podStartSLOduration=1.358851149 podStartE2EDuration="3.128838942s" podCreationTimestamp="2026-05-28 10:06:36 +0000 UTC" firstStartedPulling="2026-05-28 10:06:36.56295777 +0000 UTC m=+79.456526029" lastFinishedPulling="2026-05-28 10:06:38.33294556 +0000 UTC m=+81.226513822" observedRunningTime="2026-05-28 10:06:39.127516639 +0000 UTC m=+82.021084911" watchObservedRunningTime="2026-05-28 10:06:39.128838942 +0000 UTC m=+82.022407213"
May 28 10:06:39.133392 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.131775    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d977f6458-n2bsj"]
May 28 10:06:39.135160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.135138    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.141037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.140558    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 10:06:39.141037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.140946    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 10:06:39.142656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.141671    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dv5sw\""
May 28 10:06:39.142656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.141905    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 10:06:39.142656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.142131    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 10:06:39.142656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.142332    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dbfalqp9vacis\""
May 28 10:06:39.142656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.142345    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 10:06:39.164038 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.163999    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d977f6458-n2bsj"]
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.217939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.217984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-grpc-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218176    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218319    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218349    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec535e79-625f-4899-82ec-1885e870e0e8-metrics-client-ca\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.218464 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.218416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9xpm\" (UniqueName: \"kubernetes.io/projected/ec535e79-625f-4899-82ec-1885e870e0e8-kube-api-access-j9xpm\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319062 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319018    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319072    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-grpc-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319103    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319135    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319169    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319208    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319230    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec535e79-625f-4899-82ec-1885e870e0e8-metrics-client-ca\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.319536 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.319275    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9xpm\" (UniqueName: \"kubernetes.io/projected/ec535e79-625f-4899-82ec-1885e870e0e8-kube-api-access-j9xpm\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.321133 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.320637    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec535e79-625f-4899-82ec-1885e870e0e8-metrics-client-ca\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.322425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.322379    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.322425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.322405    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.322653 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.322630    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.323947 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.323920    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.324681 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.324641    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.325663 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.325615    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec535e79-625f-4899-82ec-1885e870e0e8-secret-grpc-tls\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.330110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.330070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9xpm\" (UniqueName: \"kubernetes.io/projected/ec535e79-625f-4899-82ec-1885e870e0e8-kube-api-access-j9xpm\") pod \"thanos-querier-6d977f6458-n2bsj\" (UID: \"ec535e79-625f-4899-82ec-1885e870e0e8\") " pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.470544 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.470289    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:39.639230 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:39.639200    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d977f6458-n2bsj"]
May 28 10:06:39.641940 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:39.641902    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec535e79_625f_4899_82ec_1885e870e0e8.slice/crio-996dd3c491511c0dfbb1aeced4aef9d8c05f18f471bb42f0d7e30a28826051e6 WatchSource:0}: Error finding container 996dd3c491511c0dfbb1aeced4aef9d8c05f18f471bb42f0d7e30a28826051e6: Status 404 returned error can't find the container with id 996dd3c491511c0dfbb1aeced4aef9d8c05f18f471bb42f0d7e30a28826051e6
May 28 10:06:40.101083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.101040    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"996dd3c491511c0dfbb1aeced4aef9d8c05f18f471bb42f0d7e30a28826051e6"}
May 28 10:06:40.103348 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.103320    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8czws" event={"ID":"62f74565-7d8d-4370-8de7-1103edb7e813","Type":"ContainerStarted","Data":"62eb79f3822914675f4f9501be06538105b1ef42d238c4d8c37b05f82f63b146"}
May 28 10:06:40.103474 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.103354    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8czws" event={"ID":"62f74565-7d8d-4370-8de7-1103edb7e813","Type":"ContainerStarted","Data":"52bd96e13e995c3ed913700a82df2653258b7de968a310df1c172d1e6a7fb6a8"}
May 28 10:06:40.127254 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.127215    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8czws" podStartSLOduration=2.787644137 podStartE2EDuration="4.127203252s" podCreationTimestamp="2026-05-28 10:06:36 +0000 UTC" firstStartedPulling="2026-05-28 10:06:36.996257822 +0000 UTC m=+79.889826074" lastFinishedPulling="2026-05-28 10:06:38.335816936 +0000 UTC m=+81.229385189" observedRunningTime="2026-05-28 10:06:40.125917324 +0000 UTC m=+83.019485606" watchObservedRunningTime="2026-05-28 10:06:40.127203252 +0000 UTC m=+83.020771521"
May 28 10:06:40.342561 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.342518    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-684785568b-qqtbn"]
May 28 10:06:40.348306 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.348285    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.351892 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.351825    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lhjz5\""
May 28 10:06:40.352125 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.352102    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 10:06:40.352241 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.352209    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 10:06:40.352444 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.352426    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 10:06:40.352672 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.352656    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 10:06:40.352752 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.352695    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8qtfpb62dnhk6\""
May 28 10:06:40.364845 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.364824    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-684785568b-qqtbn"]
May 28 10:06:40.429477 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-tls\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429477 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429484    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvst\" (UniqueName: \"kubernetes.io/projected/e746ae5f-533a-4330-8893-f959c9579fa7-kube-api-access-jdvst\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-metrics-server-audit-profiles\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-client-certs\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-client-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.429719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.429690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e746ae5f-533a-4330-8893-f959c9579fa7-audit-log\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530725    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-tls\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530761    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvst\" (UniqueName: \"kubernetes.io/projected/e746ae5f-533a-4330-8893-f959c9579fa7-kube-api-access-jdvst\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530805    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-metrics-server-audit-profiles\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530837    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-client-certs\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530894    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-client-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530929    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.530978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.530953    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e746ae5f-533a-4330-8893-f959c9579fa7-audit-log\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.531334 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.531306    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e746ae5f-533a-4330-8893-f959c9579fa7-audit-log\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.531849 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.531803    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.531958 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.531859    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e746ae5f-533a-4330-8893-f959c9579fa7-metrics-server-audit-profiles\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.533829 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.533806    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-client-certs\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.533952 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.533931    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-secret-metrics-server-tls\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.534032 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.533988    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e746ae5f-533a-4330-8893-f959c9579fa7-client-ca-bundle\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.539907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.539886    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvst\" (UniqueName: \"kubernetes.io/projected/e746ae5f-533a-4330-8893-f959c9579fa7-kube-api-access-jdvst\") pod \"metrics-server-684785568b-qqtbn\" (UID: \"e746ae5f-533a-4330-8893-f959c9579fa7\") " pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:40.659755 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:40.659678    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:06:41.215923 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.215886    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bd857747b-fwz5b"]
May 28 10:06:41.219652 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.219623    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.227771 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227750    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 10:06:41.227955 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227747    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v9wzk\""
May 28 10:06:41.228077 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227768    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 10:06:41.228155 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227766    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 10:06:41.228155 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227810    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 10:06:41.228263 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.227813    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 10:06:41.233521 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.233500    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 10:06:41.239928 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.239911    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bd857747b-fwz5b"]
May 28 10:06:41.336918 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.336885    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.336926    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-serving-certs-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.336959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n9v\" (UniqueName: \"kubernetes.io/projected/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-kube-api-access-68n9v\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.337049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.337083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-metrics-client-ca\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.337107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337317 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.337171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.337317 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.337209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-federate-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.438315 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.438277    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.438483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.438331    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-metrics-client-ca\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439038 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.438985    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439163 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439074    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439163 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439118    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-federate-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439163 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439157    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-metrics-client-ca\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439190    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-serving-certs-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439272 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439228    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68n9v\" (UniqueName: \"kubernetes.io/projected/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-kube-api-access-68n9v\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439435 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439291    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.439907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.439887    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-serving-certs-ca-bundle\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.441992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.441967    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.442253 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.442230    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-federate-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.442330 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.442230    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-telemeter-client-tls\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.443660 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.443622    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-secret-telemeter-client\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.453212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.453172    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n9v\" (UniqueName: \"kubernetes.io/projected/f9bf3734-3b0c-4267-bf5d-c33fef1a2306-kube-api-access-68n9v\") pod \"telemeter-client-5bd857747b-fwz5b\" (UID: \"f9bf3734-3b0c-4267-bf5d-c33fef1a2306\") " pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:41.536901 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:41.536862    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b"
May 28 10:06:43.192021 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.191971    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:06:43.237275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.237239    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:06:43.241852 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.241829    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.253925 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.253906    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:06:43.357617 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5m6m\" (UniqueName: \"kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357939 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357939 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.357939 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.357896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.458870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458783    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.458870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458828    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5m6m\" (UniqueName: \"kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.458870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458865    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.459173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458893    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.459173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458920    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.459173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458947    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.459173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.458999    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.460037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.459970    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.460155 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.460128    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.460350 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.460329    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.460475 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.460447    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.461735 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.461710    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.461822 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.461741    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.469466 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.469444    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5m6m\" (UniqueName: \"kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m\") pod \"console-8c44d88d8-b5rk9\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") " pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:43.552289 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:43.552257    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:48.403130 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:48.403062    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bd857747b-fwz5b"]
May 28 10:06:48.407214 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:48.407180    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bf3734_3b0c_4267_bf5d_c33fef1a2306.slice/crio-dc4e0a8444fdd5ce377857d3627456c902553b43b88cdce1c5c9f7b2e8c3c746 WatchSource:0}: Error finding container dc4e0a8444fdd5ce377857d3627456c902553b43b88cdce1c5c9f7b2e8c3c746: Status 404 returned error can't find the container with id dc4e0a8444fdd5ce377857d3627456c902553b43b88cdce1c5c9f7b2e8c3c746
May 28 10:06:48.407214 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:48.407186    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:06:48.408315 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:48.408258    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0008a5_04f2_4422_9ab3_4c7a94e012cc.slice/crio-47b4b9bc4dd35d5bafa130a918aecef25f81daf3dc53421b24256bbd4abfb3c7 WatchSource:0}: Error finding container 47b4b9bc4dd35d5bafa130a918aecef25f81daf3dc53421b24256bbd4abfb3c7: Status 404 returned error can't find the container with id 47b4b9bc4dd35d5bafa130a918aecef25f81daf3dc53421b24256bbd4abfb3c7
May 28 10:06:48.419247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:48.419219    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-684785568b-qqtbn"]
May 28 10:06:48.422785 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:06:48.422759    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode746ae5f_533a_4330_8893_f959c9579fa7.slice/crio-aa8e70b6883f8bd1b6b7b52fd79b287e0d7fef32b2afd8298366772edbdd9716 WatchSource:0}: Error finding container aa8e70b6883f8bd1b6b7b52fd79b287e0d7fef32b2afd8298366772edbdd9716: Status 404 returned error can't find the container with id aa8e70b6883f8bd1b6b7b52fd79b287e0d7fef32b2afd8298366772edbdd9716
May 28 10:06:49.052430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.052303    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-559b4dc97d-4tkvj"
May 28 10:06:49.135688 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.134521    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-5bfkb" event={"ID":"2c87ea24-5c59-4e28-9dc5-a81ec7f670db","Type":"ContainerStarted","Data":"e6ab04e05d5440db742e10b588052d67fb31926c78acd44d300ff5ebed2e5c28"}
May 28 10:06:49.135688 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.135652    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:49.138893 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.138409    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566ffb9456-6w5rv" event={"ID":"4a038eeb-e158-41c0-ba95-02a5e12b9c38","Type":"ContainerStarted","Data":"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"}
May 28 10:06:49.139574 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.139456    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-5bfkb"
May 28 10:06:49.145472 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.145442    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c44d88d8-b5rk9" event={"ID":"0f0008a5-04f2-4422-9ab3-4c7a94e012cc","Type":"ContainerStarted","Data":"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"}
May 28 10:06:49.145611 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.145479    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c44d88d8-b5rk9" event={"ID":"0f0008a5-04f2-4422-9ab3-4c7a94e012cc","Type":"ContainerStarted","Data":"47b4b9bc4dd35d5bafa130a918aecef25f81daf3dc53421b24256bbd4abfb3c7"}
May 28 10:06:49.152164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.152115    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-684785568b-qqtbn" event={"ID":"e746ae5f-533a-4330-8893-f959c9579fa7","Type":"ContainerStarted","Data":"aa8e70b6883f8bd1b6b7b52fd79b287e0d7fef32b2afd8298366772edbdd9716"}
May 28 10:06:49.156082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.155787    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-5bfkb" podStartSLOduration=2.777330235 podStartE2EDuration="23.15577056s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="2026-05-28 10:06:27.889472594 +0000 UTC m=+70.783040847" lastFinishedPulling="2026-05-28 10:06:48.267912915 +0000 UTC m=+91.161481172" observedRunningTime="2026-05-28 10:06:49.155200765 +0000 UTC m=+92.048769036" watchObservedRunningTime="2026-05-28 10:06:49.15577056 +0000 UTC m=+92.049338845"
May 28 10:06:49.157662 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.157590    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"89064c7427ae0abcca5cff085d2dfb3bd9593bd01eac7c9b02849cb743067b6b"}
May 28 10:06:49.157662 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.157621    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"aa1d564ff0ddc2c31e569fcee51f494e77b4cfb8c9e4645e77ba26d5025aa392"}
May 28 10:06:49.157662 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.157635    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"f3e35b0abe1eaaeef1d94766107f6f4289bcdc8b082bafea3ebb3d6e80e3ff8c"}
May 28 10:06:49.159984 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.159940    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b" event={"ID":"f9bf3734-3b0c-4267-bf5d-c33fef1a2306","Type":"ContainerStarted","Data":"dc4e0a8444fdd5ce377857d3627456c902553b43b88cdce1c5c9f7b2e8c3c746"}
May 28 10:06:49.176288 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.175315    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8c44d88d8-b5rk9" podStartSLOduration=6.1752996079999996 podStartE2EDuration="6.175299608s" podCreationTimestamp="2026-05-28 10:06:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:49.17487371 +0000 UTC m=+92.068441981" watchObservedRunningTime="2026-05-28 10:06:49.175299608 +0000 UTC m=+92.068867878"
May 28 10:06:49.198199 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:49.197991    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-566ffb9456-6w5rv" podStartSLOduration=2.266207197 podStartE2EDuration="13.197972369s" podCreationTimestamp="2026-05-28 10:06:36 +0000 UTC" firstStartedPulling="2026-05-28 10:06:37.260453092 +0000 UTC m=+80.154021357" lastFinishedPulling="2026-05-28 10:06:48.192218281 +0000 UTC m=+91.085786529" observedRunningTime="2026-05-28 10:06:49.196801601 +0000 UTC m=+92.090369884" watchObservedRunningTime="2026-05-28 10:06:49.197972369 +0000 UTC m=+92.091540640"
May 28 10:06:50.168054 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:50.167395    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"82c4d9530983b065878958a6d052573e1f145be94d41c7dc50b41b7b5ab8f337"}
May 28 10:06:52.178760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.178664    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-684785568b-qqtbn" event={"ID":"e746ae5f-533a-4330-8893-f959c9579fa7","Type":"ContainerStarted","Data":"507538f82b982c08dcf878625f82564618807942842c5737fdee7ac70f167e80"}
May 28 10:06:52.181945 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.181908    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"d03a6e011e9795272299742eb215dddfd712ea273998268838936bb3e92ce726"}
May 28 10:06:52.181945 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.181950    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" event={"ID":"ec535e79-625f-4899-82ec-1885e870e0e8","Type":"ContainerStarted","Data":"ac949c6f985ef87e9768cc3f9b65197027b693997ab0caec17e25f4b35af815f"}
May 28 10:06:52.182221 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.182135    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:52.183560 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.183531    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b" event={"ID":"f9bf3734-3b0c-4267-bf5d-c33fef1a2306","Type":"ContainerStarted","Data":"38a2577c890a7d1c28b1d1b14a95cb12f83791646f978756249179dd52259b1b"}
May 28 10:06:52.198949 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.198883    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-684785568b-qqtbn" podStartSLOduration=9.019241919 podStartE2EDuration="12.198864599s" podCreationTimestamp="2026-05-28 10:06:40 +0000 UTC" firstStartedPulling="2026-05-28 10:06:48.425117961 +0000 UTC m=+91.318686223" lastFinishedPulling="2026-05-28 10:06:51.604740654 +0000 UTC m=+94.498308903" observedRunningTime="2026-05-28 10:06:52.197232133 +0000 UTC m=+95.090800427" watchObservedRunningTime="2026-05-28 10:06:52.198864599 +0000 UTC m=+95.092432870"
May 28 10:06:52.222635 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:52.222060    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj" podStartSLOduration=3.146294371 podStartE2EDuration="13.22203913s" podCreationTimestamp="2026-05-28 10:06:39 +0000 UTC" firstStartedPulling="2026-05-28 10:06:39.644230025 +0000 UTC m=+82.537798288" lastFinishedPulling="2026-05-28 10:06:49.719974785 +0000 UTC m=+92.613543047" observedRunningTime="2026-05-28 10:06:52.221774268 +0000 UTC m=+95.115342540" watchObservedRunningTime="2026-05-28 10:06:52.22203913 +0000 UTC m=+95.115607400"
May 28 10:06:53.195790 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:53.195753    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d977f6458-n2bsj"
May 28 10:06:53.553129 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:53.553079    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:53.553321 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:53.553208    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:53.558955 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:53.558923    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:54.197951 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:54.197896    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b" event={"ID":"f9bf3734-3b0c-4267-bf5d-c33fef1a2306","Type":"ContainerStarted","Data":"bb7c53bdfdc351cf85aa7848f0acba9d8bb952d39ac4a7e1425de5f5beeaab6d"}
May 28 10:06:54.197951 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:54.197956    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b" event={"ID":"f9bf3734-3b0c-4267-bf5d-c33fef1a2306","Type":"ContainerStarted","Data":"cd72234b0f968131c642bf65cbc56400feee45fe284dd06d639fe36eaa8b6c40"}
May 28 10:06:54.203075 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:54.203042    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:06:54.227064 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:54.226967    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bd857747b-fwz5b" podStartSLOduration=8.207291375 podStartE2EDuration="13.226945086s" podCreationTimestamp="2026-05-28 10:06:41 +0000 UTC" firstStartedPulling="2026-05-28 10:06:48.40961032 +0000 UTC m=+91.303178583" lastFinishedPulling="2026-05-28 10:06:53.429264032 +0000 UTC m=+96.322832294" observedRunningTime="2026-05-28 10:06:54.22630947 +0000 UTC m=+97.119877778" watchObservedRunningTime="2026-05-28 10:06:54.226945086 +0000 UTC m=+97.120513359"
May 28 10:06:57.085747 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:57.085692    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:06:59.048165 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:06:59.048124    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gqlck"
May 28 10:07:00.660660 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:00.660629    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:07:00.661066 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:00.660703    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:07:05.676089 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:05.676051    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:07:14.168970 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.168899    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-566ffb9456-6w5rv" podUID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" containerName="console" containerID="cri-o://163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207" gracePeriod=15
May 28 10:07:14.413327 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.413305    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-566ffb9456-6w5rv_4a038eeb-e158-41c0-ba95-02a5e12b9c38/console/0.log"
May 28 10:07:14.413463 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.413378    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:07:14.448496 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448411    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448496 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448465    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448704 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448536    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448704 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448577    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448704 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448610    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448704 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448634    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx284\" (UniqueName: \"kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.448915 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448854    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert\") pod \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\" (UID: \"4a038eeb-e158-41c0-ba95-02a5e12b9c38\") "
May 28 10:07:14.449039 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448989    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:14.449039 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.448998    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:14.449241 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.449001    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config" (OuterVolumeSpecName: "console-config") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:14.449344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.449324    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-service-ca\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.449413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.449334    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:14.449413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.449351    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-oauth-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.449413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.449367    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.450930 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.450899    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:14.451153 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.451129    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:14.451247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.451199    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284" (OuterVolumeSpecName: "kube-api-access-vx284") pod "4a038eeb-e158-41c0-ba95-02a5e12b9c38" (UID: "4a038eeb-e158-41c0-ba95-02a5e12b9c38"). InnerVolumeSpecName "kube-api-access-vx284". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:07:14.549875 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.549834    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a038eeb-e158-41c0-ba95-02a5e12b9c38-trusted-ca-bundle\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.549875 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.549872    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx284\" (UniqueName: \"kubernetes.io/projected/4a038eeb-e158-41c0-ba95-02a5e12b9c38-kube-api-access-vx284\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.550116 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.549886    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:14.550116 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:14.549899    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a038eeb-e158-41c0-ba95-02a5e12b9c38-console-oauth-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:15.262480 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262450    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-566ffb9456-6w5rv_4a038eeb-e158-41c0-ba95-02a5e12b9c38/console/0.log"
May 28 10:07:15.262887 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262490    2556 generic.go:358] "Generic (PLEG): container finished" podID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" containerID="163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207" exitCode=2
May 28 10:07:15.262887 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262523    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566ffb9456-6w5rv" event={"ID":"4a038eeb-e158-41c0-ba95-02a5e12b9c38","Type":"ContainerDied","Data":"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"}
May 28 10:07:15.262887 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262566    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566ffb9456-6w5rv" event={"ID":"4a038eeb-e158-41c0-ba95-02a5e12b9c38","Type":"ContainerDied","Data":"51e7c59e5764dacf46bc43998a5c8673b32000f5f2ed2680ada8d7d7142cc425"}
May 28 10:07:15.262887 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262566    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566ffb9456-6w5rv"
May 28 10:07:15.262887 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.262626    2556 scope.go:117] "RemoveContainer" containerID="163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"
May 28 10:07:15.275986 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.275964    2556 scope.go:117] "RemoveContainer" containerID="163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"
May 28 10:07:15.276417 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:07:15.276377    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207\": container with ID starting with 163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207 not found: ID does not exist" containerID="163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"
May 28 10:07:15.276516 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.276424    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207"} err="failed to get container status \"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207\": rpc error: code = NotFound desc = could not find container \"163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207\": container with ID starting with 163a72d296f0be846ac50c8c342ec195c16b5f30a415492f6cfe111a7a84c207 not found: ID does not exist"
May 28 10:07:15.288600 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.288566    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:07:15.292377 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.292351    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566ffb9456-6w5rv"]
May 28 10:07:15.701122 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:15.701045    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" path="/var/lib/kubelet/pods/4a038eeb-e158-41c0-ba95-02a5e12b9c38/volumes"
May 28 10:07:20.665583 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:20.665553    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:07:20.669586 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:20.669559    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-684785568b-qqtbn"
May 28 10:07:30.695247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:30.695182    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8c44d88d8-b5rk9" podUID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" containerName="console" containerID="cri-o://b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016" gracePeriod=15
May 28 10:07:30.968173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:30.968146    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8c44d88d8-b5rk9_0f0008a5-04f2-4422-9ab3-4c7a94e012cc/console/0.log"
May 28 10:07:30.968345 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:30.968227    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:07:31.080795 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.080756    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.080981 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.080848    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.080981 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.080898    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.081107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.080984    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.081107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081031    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.081107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081053    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.081107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081089    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5m6m\" (UniqueName: \"kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m\") pod \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\" (UID: \"0f0008a5-04f2-4422-9ab3-4c7a94e012cc\") "
May 28 10:07:31.081376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081182    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:31.081376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081312    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:31.081376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081365    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-trusted-ca-bundle\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.081527 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081494    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config" (OuterVolumeSpecName: "console-config") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:31.081659 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.081632    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:07:31.083200 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.083166    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:31.083322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.083270    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m" (OuterVolumeSpecName: "kube-api-access-d5m6m") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "kube-api-access-d5m6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:07:31.083540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.083517    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f0008a5-04f2-4422-9ab3-4c7a94e012cc" (UID: "0f0008a5-04f2-4422-9ab3-4c7a94e012cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:07:31.182153 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182108    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.182336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182148    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-oauth-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.182336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182179    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-oauth-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.182336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182192    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-console-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.182336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182205    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-service-ca\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.182336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.182216    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5m6m\" (UniqueName: \"kubernetes.io/projected/0f0008a5-04f2-4422-9ab3-4c7a94e012cc-kube-api-access-d5m6m\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:07:31.311764 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.311736    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8c44d88d8-b5rk9_0f0008a5-04f2-4422-9ab3-4c7a94e012cc/console/0.log"
May 28 10:07:31.311964 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.311787    2556 generic.go:358] "Generic (PLEG): container finished" podID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" containerID="b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016" exitCode=2
May 28 10:07:31.311964 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.311887    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c44d88d8-b5rk9" event={"ID":"0f0008a5-04f2-4422-9ab3-4c7a94e012cc","Type":"ContainerDied","Data":"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"}
May 28 10:07:31.311964 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.311920    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c44d88d8-b5rk9" event={"ID":"0f0008a5-04f2-4422-9ab3-4c7a94e012cc","Type":"ContainerDied","Data":"47b4b9bc4dd35d5bafa130a918aecef25f81daf3dc53421b24256bbd4abfb3c7"}
May 28 10:07:31.311964 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.311939    2556 scope.go:117] "RemoveContainer" containerID="b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"
May 28 10:07:31.312197 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.312111    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c44d88d8-b5rk9"
May 28 10:07:31.321065 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.321036    2556 scope.go:117] "RemoveContainer" containerID="b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"
May 28 10:07:31.321384 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:07:31.321364    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016\": container with ID starting with b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016 not found: ID does not exist" containerID="b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"
May 28 10:07:31.321459 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.321399    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016"} err="failed to get container status \"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016\": rpc error: code = NotFound desc = could not find container \"b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016\": container with ID starting with b7920dbf01adbd4ab4601fb2875f4cc8cc88071af648488f3c7bfc345908e016 not found: ID does not exist"
May 28 10:07:31.335543 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.335497    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:07:31.337264 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.337234    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c44d88d8-b5rk9"]
May 28 10:07:31.701674 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:31.701587    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" path="/var/lib/kubelet/pods/0f0008a5-04f2-4422-9ab3-4c7a94e012cc/volumes"
May 28 10:07:58.146624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146591    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146882    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" containerName="console"
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146893    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" containerName="console"
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146902    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" containerName="console"
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146908    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" containerName="console"
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146952    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a038eeb-e158-41c0-ba95-02a5e12b9c38" containerName="console"
May 28 10:07:58.147082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.146960    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f0008a5-04f2-4422-9ab3-4c7a94e012cc" containerName="console"
May 28 10:07:58.150409 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.150384    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.153782 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.153754    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 10:07:58.154043 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154028    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 10:07:58.154137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154052    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 10:07:58.154137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154056    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dcnqg\""
May 28 10:07:58.154137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154106    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 10:07:58.154273 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154190    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 10:07:58.154273 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154190    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 10:07:58.154519 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154503    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 10:07:58.154757 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.154736    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 10:07:58.160047 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.160026    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 10:07:58.164421 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.164395    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:58.311737 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311737 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-config-out\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311778    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-web-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2jkz\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-kube-api-access-k2jkz\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.311972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.311947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.312238 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.312001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.312238 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.312066    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.312238 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.312085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413329 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413231    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413329 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413282    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-config-out\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413329 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413319    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-web-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413344    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2jkz\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-kube-api-access-k2jkz\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413369    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413385    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413406    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413427    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413456    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413480    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413516    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413576    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.413624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413601    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.414148 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.413705    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.414287 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.414261    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416256 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416223    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba748922-fad7-4155-967c-60be1e05f900-config-out\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416517    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416581    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416591    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416715    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-web-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.416967 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.416818    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.417268 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.417241    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba748922-fad7-4155-967c-60be1e05f900-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.417357 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.417314    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.418202 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.418184    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba748922-fad7-4155-967c-60be1e05f900-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.422356 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.422319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2jkz\" (UniqueName: \"kubernetes.io/projected/ba748922-fad7-4155-967c-60be1e05f900-kube-api-access-k2jkz\") pod \"alertmanager-main-0\" (UID: \"ba748922-fad7-4155-967c-60be1e05f900\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.460199 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.460162    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 10:07:58.605766 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:58.605736    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 10:07:58.608073 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:07:58.607994    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba748922_fad7_4155_967c_60be1e05f900.slice/crio-cfe83619c8e8202a826458b2579e8d9ecdd3fe37fa547887fd9ea68640ed36b9 WatchSource:0}: Error finding container cfe83619c8e8202a826458b2579e8d9ecdd3fe37fa547887fd9ea68640ed36b9: Status 404 returned error can't find the container with id cfe83619c8e8202a826458b2579e8d9ecdd3fe37fa547887fd9ea68640ed36b9
May 28 10:07:59.391363 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:59.391323    2556 generic.go:358] "Generic (PLEG): container finished" podID="ba748922-fad7-4155-967c-60be1e05f900" containerID="fe02b4a1fad60ccba739b428bea8b61b945ddcf256fa0d3307b37ff62d210e8d" exitCode=0
May 28 10:07:59.391770 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:59.391417    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerDied","Data":"fe02b4a1fad60ccba739b428bea8b61b945ddcf256fa0d3307b37ff62d210e8d"}
May 28 10:07:59.391770 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:07:59.391456    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"cfe83619c8e8202a826458b2579e8d9ecdd3fe37fa547887fd9ea68640ed36b9"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400893    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"ce2983d7bef3c0389d76e4c97cafd914f9d82a1daaaeef0a0dfe891173a850d4"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400933    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"0a96ba7283b47372c0121c203107ad76facc67912234e54a9aa00735b7307fe4"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400946    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"92a28975acba40c4c1fbeefeb5c0e630ac380681d801da81117e617045146fdd"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400959    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"12c903acdd1cc08a02641545fd771b018ae6d8da98cf94f1a86c7fc9150bf476"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400970    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"c8973d3ad5f536aeedfaf71c8aec2940173d49312ab3615a3b7dd443d4f674c1"}
May 28 10:08:01.400990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.400981    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba748922-fad7-4155-967c-60be1e05f900","Type":"ContainerStarted","Data":"5ad422e4ecb05eaf1c3892471267d44c02bb4ca61523e65623f56aec4be7b00a"}
May 28 10:08:01.445360 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:01.445285    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.980689324 podStartE2EDuration="3.445264135s" podCreationTimestamp="2026-05-28 10:07:58 +0000 UTC" firstStartedPulling="2026-05-28 10:07:59.39249568 +0000 UTC m=+162.286063929" lastFinishedPulling="2026-05-28 10:08:00.857070487 +0000 UTC m=+163.750638740" observedRunningTime="2026-05-28 10:08:01.442423143 +0000 UTC m=+164.335991413" watchObservedRunningTime="2026-05-28 10:08:01.445264135 +0000 UTC m=+164.338832408"
May 28 10:08:03.501243 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.501206    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:08:03.503535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.503515    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.506118 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.506094    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 10:08:03.506830 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.506816    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 10:08:03.507034 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.506991    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 10:08:03.507128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.507063    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 10:08:03.507128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.507074    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 10:08:03.507981 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.507964    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4585z\""
May 28 10:08:03.512035 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.511989    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 10:08:03.516589 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.516565    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:08:03.664708 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvxcg\" (UniqueName: \"kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.664891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.664869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.765814 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765713    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.765814 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765774    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.765814 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765801    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvxcg\" (UniqueName: \"kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765828    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765848    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765875    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766128 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.765891    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766682 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.766650    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766796 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.766709    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766796 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.766728    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.766796 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.766761    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.768452 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.768431    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.768547 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.768433    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.775408 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.775376    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvxcg\" (UniqueName: \"kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg\") pod \"console-5cfdc4fbb-67xg2\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") " pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.814104 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.814061    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:03.952291 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:03.952253    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:08:03.955451 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:08:03.955422    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a29b939_0335_4afe_82e8_6adb62d46ee8.slice/crio-1a11bdb84d52a7fe07a7932cc13ed0399c7bc918cb138ad365b83b74e6f955e6 WatchSource:0}: Error finding container 1a11bdb84d52a7fe07a7932cc13ed0399c7bc918cb138ad365b83b74e6f955e6: Status 404 returned error can't find the container with id 1a11bdb84d52a7fe07a7932cc13ed0399c7bc918cb138ad365b83b74e6f955e6
May 28 10:08:04.410684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:04.410644    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfdc4fbb-67xg2" event={"ID":"0a29b939-0335-4afe-82e8-6adb62d46ee8","Type":"ContainerStarted","Data":"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"}
May 28 10:08:04.410684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:04.410683    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfdc4fbb-67xg2" event={"ID":"0a29b939-0335-4afe-82e8-6adb62d46ee8","Type":"ContainerStarted","Data":"1a11bdb84d52a7fe07a7932cc13ed0399c7bc918cb138ad365b83b74e6f955e6"}
May 28 10:08:04.442212 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:04.442152    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5cfdc4fbb-67xg2" podStartSLOduration=1.442136878 podStartE2EDuration="1.442136878s" podCreationTimestamp="2026-05-28 10:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:08:04.438661786 +0000 UTC m=+167.332230055" watchObservedRunningTime="2026-05-28 10:08:04.442136878 +0000 UTC m=+167.335705147"
May 28 10:08:13.814365 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:13.814267    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:13.814365 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:13.814312    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:13.819169 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:13.819141    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:14.446146 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:14.446113    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:08:52.063042 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.062994    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-f8d6x"]
May 28 10:08:52.066286 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.066262    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.069325 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.069303    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 10:08:52.075835 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.075811    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8d6x"]
May 28 10:08:52.180289 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.180249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f6a2ed6-c938-4000-a381-32e5467f7083-original-pull-secret\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.180497 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.180324    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-dbus\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.180497 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.180381    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-kubelet-config\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.281093 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.281048    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f6a2ed6-c938-4000-a381-32e5467f7083-original-pull-secret\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.281304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.281122    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-dbus\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.281304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.281155    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-kubelet-config\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.281304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.281254    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-kubelet-config\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.281417 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.281305    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f6a2ed6-c938-4000-a381-32e5467f7083-dbus\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.283546 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.283520    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f6a2ed6-c938-4000-a381-32e5467f7083-original-pull-secret\") pod \"global-pull-secret-syncer-f8d6x\" (UID: \"1f6a2ed6-c938-4000-a381-32e5467f7083\") " pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.375903 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.375816    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8d6x"
May 28 10:08:52.506063 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.506034    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8d6x"]
May 28 10:08:52.508681 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:08:52.508655    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6a2ed6_c938_4000_a381_32e5467f7083.slice/crio-77df69fd3f028c86a007594eb4017a61ac00641dc8b26abfbbb5bf4b531fae71 WatchSource:0}: Error finding container 77df69fd3f028c86a007594eb4017a61ac00641dc8b26abfbbb5bf4b531fae71: Status 404 returned error can't find the container with id 77df69fd3f028c86a007594eb4017a61ac00641dc8b26abfbbb5bf4b531fae71
May 28 10:08:52.555256 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:52.555217    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8d6x" event={"ID":"1f6a2ed6-c938-4000-a381-32e5467f7083","Type":"ContainerStarted","Data":"77df69fd3f028c86a007594eb4017a61ac00641dc8b26abfbbb5bf4b531fae71"}
May 28 10:08:56.569123 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:56.569033    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8d6x" event={"ID":"1f6a2ed6-c938-4000-a381-32e5467f7083","Type":"ContainerStarted","Data":"2edeef7c6c72df55d8c9fe72f960ddee531339e764f5694a203b2141d5dccc66"}
May 28 10:08:56.587393 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:08:56.587338    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f8d6x" podStartSLOduration=0.797747401 podStartE2EDuration="4.587322606s" podCreationTimestamp="2026-05-28 10:08:52 +0000 UTC" firstStartedPulling="2026-05-28 10:08:52.510894736 +0000 UTC m=+215.404462987" lastFinishedPulling="2026-05-28 10:08:56.300469945 +0000 UTC m=+219.194038192" observedRunningTime="2026-05-28 10:08:56.585739563 +0000 UTC m=+219.479307833" watchObservedRunningTime="2026-05-28 10:08:56.587322606 +0000 UTC m=+219.480890876"
May 28 10:10:17.622706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:17.622681    2556 kubelet.go:1628] "Image garbage collection succeeded"
May 28 10:10:23.050498 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.050467    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:10:23.053451 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.053433    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:23.055894 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.055875    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 10:10:23.055894 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.055881    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-9bbl4\""
May 28 10:10:23.056768 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.056751    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 10:10:23.065204 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.065183    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:10:23.157506 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.157478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntpz\" (UniqueName: \"kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz\") pod \"feast-operator-controller-manager-85c85d8bdf-hkmlv\" (UID: \"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d\") " pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:23.258807 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.258780    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rntpz\" (UniqueName: \"kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz\") pod \"feast-operator-controller-manager-85c85d8bdf-hkmlv\" (UID: \"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d\") " pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:23.270220 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.270191    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntpz\" (UniqueName: \"kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz\") pod \"feast-operator-controller-manager-85c85d8bdf-hkmlv\" (UID: \"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d\") " pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:23.363342 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.363274    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:23.487286 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.487266    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:10:23.490366 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:10:23.490331    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d8f2e4_bcfb_42c4_a5f0_17225eef902d.slice/crio-82c295d60f35a461f4c53496778dadcbe79e59d29d4fa02b6943a6fc180254f4 WatchSource:0}: Error finding container 82c295d60f35a461f4c53496778dadcbe79e59d29d4fa02b6943a6fc180254f4: Status 404 returned error can't find the container with id 82c295d60f35a461f4c53496778dadcbe79e59d29d4fa02b6943a6fc180254f4
May 28 10:10:23.492165 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.492147    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:10:23.802924 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:23.802890    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" event={"ID":"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d","Type":"ContainerStarted","Data":"82c295d60f35a461f4c53496778dadcbe79e59d29d4fa02b6943a6fc180254f4"}
May 28 10:10:26.813518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:26.813483    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" event={"ID":"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d","Type":"ContainerStarted","Data":"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"}
May 28 10:10:26.813971 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:26.813573    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:10:26.830794 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:26.830752    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" podStartSLOduration=1.120602687 podStartE2EDuration="3.830739531s" podCreationTimestamp="2026-05-28 10:10:23 +0000 UTC" firstStartedPulling="2026-05-28 10:10:23.492272451 +0000 UTC m=+306.385840699" lastFinishedPulling="2026-05-28 10:10:26.202409293 +0000 UTC m=+309.095977543" observedRunningTime="2026-05-28 10:10:26.829489976 +0000 UTC m=+309.723058241" watchObservedRunningTime="2026-05-28 10:10:26.830739531 +0000 UTC m=+309.724307791"
May 28 10:10:37.819945 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:10:37.819912    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:16:25.165160 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.165122    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:16:25.168811 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.168784    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:16:25.171569 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.171547    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 10:16:25.171719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.171546    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 10:16:25.172925 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.172876    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-65lqm\""
May 28 10:16:25.175051 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.175027    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:16:25.269276 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.269241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbdbf\" (UniqueName: \"kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf\") pod \"redis-854544c579-7lh2j\" (UID: \"de8c4353-d680-41c1-b32a-7ac6aca908c4\") " pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:16:25.370693 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.370647    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbdbf\" (UniqueName: \"kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf\") pod \"redis-854544c579-7lh2j\" (UID: \"de8c4353-d680-41c1-b32a-7ac6aca908c4\") " pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:16:25.379735 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.379700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbdbf\" (UniqueName: \"kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf\") pod \"redis-854544c579-7lh2j\" (UID: \"de8c4353-d680-41c1-b32a-7ac6aca908c4\") " pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:16:25.491744 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.491700    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:16:25.619027 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.618988    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:16:25.621692 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:16:25.621661    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde8c4353_d680_41c1_b32a_7ac6aca908c4.slice/crio-7e139bbb1e7b3437c65270055a5dd5a7f1f075ff9c3e8110c64987aabd58fcb9 WatchSource:0}: Error finding container 7e139bbb1e7b3437c65270055a5dd5a7f1f075ff9c3e8110c64987aabd58fcb9: Status 404 returned error can't find the container with id 7e139bbb1e7b3437c65270055a5dd5a7f1f075ff9c3e8110c64987aabd58fcb9
May 28 10:16:25.623455 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.623436    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:16:25.815114 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:25.815034    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-7lh2j" event={"ID":"de8c4353-d680-41c1-b32a-7ac6aca908c4","Type":"ContainerStarted","Data":"7e139bbb1e7b3437c65270055a5dd5a7f1f075ff9c3e8110c64987aabd58fcb9"}
May 28 10:16:27.821710 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:27.821678    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-7lh2j" event={"ID":"de8c4353-d680-41c1-b32a-7ac6aca908c4","Type":"ContainerStarted","Data":"dc56c2b3da62571124b9834f1207d5296423b0bafe4a8908ff6b38a12c623465"}
May 28 10:16:27.838972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:27.838925    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-7lh2j" podStartSLOduration=1.224711139 podStartE2EDuration="2.838909177s" podCreationTimestamp="2026-05-28 10:16:25 +0000 UTC" firstStartedPulling="2026-05-28 10:16:25.62359135 +0000 UTC m=+668.517159598" lastFinishedPulling="2026-05-28 10:16:27.237789385 +0000 UTC m=+670.131357636" observedRunningTime="2026-05-28 10:16:27.838319376 +0000 UTC m=+670.731887648" watchObservedRunningTime="2026-05-28 10:16:27.838909177 +0000 UTC m=+670.732477447"
May 28 10:16:58.617304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.617275    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-82hxk"]
May 28 10:16:58.622122 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.622106    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:16:58.624765 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.624706    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-vp4tp\""
May 28 10:16:58.624765 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.624758    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 10:16:58.627247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.627223    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-82hxk"]
May 28 10:16:58.736263 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.736237    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vt9b\" (UniqueName: \"kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b\") pod \"feast-test-apply-82hxk\" (UID: \"5c18f00e-b57e-49cb-908f-009554e45b83\") " pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:16:58.837425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.837403    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vt9b\" (UniqueName: \"kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b\") pod \"feast-test-apply-82hxk\" (UID: \"5c18f00e-b57e-49cb-908f-009554e45b83\") " pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:16:58.846470 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.846448    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vt9b\" (UniqueName: \"kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b\") pod \"feast-test-apply-82hxk\" (UID: \"5c18f00e-b57e-49cb-908f-009554e45b83\") " pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:16:58.931826 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:58.931776    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:16:59.051878 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:59.051835    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-82hxk"]
May 28 10:16:59.054106 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:16:59.054076    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c18f00e_b57e_49cb_908f_009554e45b83.slice/crio-4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95 WatchSource:0}: Error finding container 4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95: Status 404 returned error can't find the container with id 4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95
May 28 10:16:59.915756 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:16:59.915719    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerStarted","Data":"4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95"}
May 28 10:17:04.933692 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:04.933659    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerStarted","Data":"7d140cefb5b024a20fca29777e8f5f9e27ddc742bb39111f4ffd54f5ce7f2379"}
May 28 10:17:10.954376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:10.954342    2556 generic.go:358] "Generic (PLEG): container finished" podID="5c18f00e-b57e-49cb-908f-009554e45b83" containerID="7d140cefb5b024a20fca29777e8f5f9e27ddc742bb39111f4ffd54f5ce7f2379" exitCode=0
May 28 10:17:10.954833 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:10.954417    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerDied","Data":"7d140cefb5b024a20fca29777e8f5f9e27ddc742bb39111f4ffd54f5ce7f2379"}
May 28 10:17:11.958653 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:11.958621    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerStarted","Data":"76a2a09e8562e727399a78334348cf5cee75af27e70d2b6f25d359f422b3c9bc"}
May 28 10:17:11.977426 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:11.977380    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-82hxk" podStartSLOduration=8.813944086 podStartE2EDuration="13.977368452s" podCreationTimestamp="2026-05-28 10:16:58 +0000 UTC" firstStartedPulling="2026-05-28 10:16:59.055830988 +0000 UTC m=+701.949399235" lastFinishedPulling="2026-05-28 10:17:04.219255337 +0000 UTC m=+707.112823601" observedRunningTime="2026-05-28 10:17:11.976053673 +0000 UTC m=+714.869621934" watchObservedRunningTime="2026-05-28 10:17:11.977368452 +0000 UTC m=+714.870936721"
May 28 10:17:14.926548 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.926514    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6bdc646b-r99p4"]
May 28 10:17:14.929823 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.929797    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.938860 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.938837    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6bdc646b-r99p4"]
May 28 10:17:14.966203 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-oauth-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966324 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ckj\" (UniqueName: \"kubernetes.io/projected/72bb7873-ee5d-42de-af1e-2628d0a5b27f-kube-api-access-t4ckj\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966324 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966417 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-oauth-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966417 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966407    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-service-ca\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966490 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-trusted-ca-bundle\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:14.966533 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:14.966497    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067549 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067522    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ckj\" (UniqueName: \"kubernetes.io/projected/72bb7873-ee5d-42de-af1e-2628d0a5b27f-kube-api-access-t4ckj\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067642 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067558    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067642 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067573    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-oauth-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067642 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067593    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-service-ca\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067642 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067632    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-trusted-ca-bundle\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067821 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067651    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.067821 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.067697    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-oauth-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.068327 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.068304    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-oauth-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.068406 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.068382    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-service-ca\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.068465 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.068411    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.068546 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.068528    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72bb7873-ee5d-42de-af1e-2628d0a5b27f-trusted-ca-bundle\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.070024 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.069977    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-oauth-config\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.070024 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.070019    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72bb7873-ee5d-42de-af1e-2628d0a5b27f-console-serving-cert\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.078237 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.078218    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ckj\" (UniqueName: \"kubernetes.io/projected/72bb7873-ee5d-42de-af1e-2628d0a5b27f-kube-api-access-t4ckj\") pod \"console-5f6bdc646b-r99p4\" (UID: \"72bb7873-ee5d-42de-af1e-2628d0a5b27f\") " pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.240052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.240035    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:15.377403 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.377378    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6bdc646b-r99p4"]
May 28 10:17:15.379629 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:17:15.379601    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bb7873_ee5d_42de_af1e_2628d0a5b27f.slice/crio-838b660f585b1dcef3600e566c62e4c9ace2b64ef9b9b6ddc32b1251b2fbb76f WatchSource:0}: Error finding container 838b660f585b1dcef3600e566c62e4c9ace2b64ef9b9b6ddc32b1251b2fbb76f: Status 404 returned error can't find the container with id 838b660f585b1dcef3600e566c62e4c9ace2b64ef9b9b6ddc32b1251b2fbb76f
May 28 10:17:15.971222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.971189    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bdc646b-r99p4" event={"ID":"72bb7873-ee5d-42de-af1e-2628d0a5b27f","Type":"ContainerStarted","Data":"6f8c8ad9e08db9a54dd3d67e78da89810c083db2a74a54a0e9d885110d7d8ade"}
May 28 10:17:15.971222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.971226    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6bdc646b-r99p4" event={"ID":"72bb7873-ee5d-42de-af1e-2628d0a5b27f","Type":"ContainerStarted","Data":"838b660f585b1dcef3600e566c62e4c9ace2b64ef9b9b6ddc32b1251b2fbb76f"}
May 28 10:17:15.992929 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:15.992888    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5f6bdc646b-r99p4" podStartSLOduration=1.992851377 podStartE2EDuration="1.992851377s" podCreationTimestamp="2026-05-28 10:17:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:17:15.991108046 +0000 UTC m=+718.884676341" watchObservedRunningTime="2026-05-28 10:17:15.992851377 +0000 UTC m=+718.886419647"
May 28 10:17:19.983630 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:19.983604    2556 generic.go:358] "Generic (PLEG): container finished" podID="5c18f00e-b57e-49cb-908f-009554e45b83" containerID="76a2a09e8562e727399a78334348cf5cee75af27e70d2b6f25d359f422b3c9bc" exitCode=0
May 28 10:17:19.983917 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:19.983671    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerDied","Data":"76a2a09e8562e727399a78334348cf5cee75af27e70d2b6f25d359f422b3c9bc"}
May 28 10:17:21.111174 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.111151    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:17:21.218057 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.218023    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vt9b\" (UniqueName: \"kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b\") pod \"5c18f00e-b57e-49cb-908f-009554e45b83\" (UID: \"5c18f00e-b57e-49cb-908f-009554e45b83\") "
May 28 10:17:21.220126 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.220099    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b" (OuterVolumeSpecName: "kube-api-access-2vt9b") pod "5c18f00e-b57e-49cb-908f-009554e45b83" (UID: "5c18f00e-b57e-49cb-908f-009554e45b83"). InnerVolumeSpecName "kube-api-access-2vt9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:17:21.318533 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.318474    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vt9b\" (UniqueName: \"kubernetes.io/projected/5c18f00e-b57e-49cb-908f-009554e45b83-kube-api-access-2vt9b\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:21.991315 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.991283    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-82hxk" event={"ID":"5c18f00e-b57e-49cb-908f-009554e45b83","Type":"ContainerDied","Data":"4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95"}
May 28 10:17:21.991315 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.991316    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e23f6b4a3df4b82908eb2076c13e461d76b7cd9015a2c20aa88bf7da16eda95"
May 28 10:17:21.991489 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:21.991292    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-82hxk"
May 28 10:17:22.169876 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:22.169849    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-82hxk_5c18f00e-b57e-49cb-908f-009554e45b83/feast-0/0.log"
May 28 10:17:22.175988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:22.175966    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-82hxk_5c18f00e-b57e-49cb-908f-009554e45b83/feast-1/0.log"
May 28 10:17:25.240966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:25.240940    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:25.240966 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:25.240970    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:25.245444 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:25.245423    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:26.012306 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:26.012281    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6bdc646b-r99p4"
May 28 10:17:26.059805 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:26.059769    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:17:51.082781 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.082731    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5cfdc4fbb-67xg2" podUID="0a29b939-0335-4afe-82e8-6adb62d46ee8" containerName="console" containerID="cri-o://d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8" gracePeriod=15
May 28 10:17:51.326279 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.326260    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cfdc4fbb-67xg2_0a29b939-0335-4afe-82e8-6adb62d46ee8/console/0.log"
May 28 10:17:51.326372 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.326321    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:17:51.453585 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453528    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453585 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453568    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453733 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453590    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453733 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453713    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvxcg\" (UniqueName: \"kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453810 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453754    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453810 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453801    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453899 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453871    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle\") pod \"0a29b939-0335-4afe-82e8-6adb62d46ee8\" (UID: \"0a29b939-0335-4afe-82e8-6adb62d46ee8\") "
May 28 10:17:51.453951 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453916    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config" (OuterVolumeSpecName: "console-config") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:17:51.454063 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.453946    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:17:51.454257 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.454233    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:17:51.454337 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.454264    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-service-ca\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.454337 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.454283    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.454337 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.454293    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:17:51.455763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.455739    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:17:51.455845 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.455769    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg" (OuterVolumeSpecName: "kube-api-access-zvxcg") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "kube-api-access-zvxcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:17:51.455845 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.455789    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a29b939-0335-4afe-82e8-6adb62d46ee8" (UID: "0a29b939-0335-4afe-82e8-6adb62d46ee8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:17:51.555309 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.555286    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-oauth-config\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.555309 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.555309    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvxcg\" (UniqueName: \"kubernetes.io/projected/0a29b939-0335-4afe-82e8-6adb62d46ee8-kube-api-access-zvxcg\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.555436 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.555319    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a29b939-0335-4afe-82e8-6adb62d46ee8-console-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.555436 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.555328    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-oauth-serving-cert\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:51.555436 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:51.555337    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a29b939-0335-4afe-82e8-6adb62d46ee8-trusted-ca-bundle\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:52.084587 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084567    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cfdc4fbb-67xg2_0a29b939-0335-4afe-82e8-6adb62d46ee8/console/0.log"
May 28 10:17:52.084933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084600    2556 generic.go:358] "Generic (PLEG): container finished" podID="0a29b939-0335-4afe-82e8-6adb62d46ee8" containerID="d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8" exitCode=2
May 28 10:17:52.084933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084663    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfdc4fbb-67xg2"
May 28 10:17:52.084933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084691    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfdc4fbb-67xg2" event={"ID":"0a29b939-0335-4afe-82e8-6adb62d46ee8","Type":"ContainerDied","Data":"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"}
May 28 10:17:52.084933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084729    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfdc4fbb-67xg2" event={"ID":"0a29b939-0335-4afe-82e8-6adb62d46ee8","Type":"ContainerDied","Data":"1a11bdb84d52a7fe07a7932cc13ed0399c7bc918cb138ad365b83b74e6f955e6"}
May 28 10:17:52.084933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.084744    2556 scope.go:117] "RemoveContainer" containerID="d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"
May 28 10:17:52.092312 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.092298    2556 scope.go:117] "RemoveContainer" containerID="d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"
May 28 10:17:52.092547 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:17:52.092527    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8\": container with ID starting with d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8 not found: ID does not exist" containerID="d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"
May 28 10:17:52.092634 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.092552    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8"} err="failed to get container status \"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8\": rpc error: code = NotFound desc = could not find container \"d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8\": container with ID starting with d42a0bcb795c50d7e770d62881faa429b3902bc64a9d3ef57a1efa927aa1efb8 not found: ID does not exist"
May 28 10:17:52.103602 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.103563    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:17:52.104894 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:52.104875    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfdc4fbb-67xg2"]
May 28 10:17:53.701498 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:53.701452    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a29b939-0335-4afe-82e8-6adb62d46ee8" path="/var/lib/kubelet/pods/0a29b939-0335-4afe-82e8-6adb62d46ee8/volumes"
May 28 10:17:56.942891 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:56.942858    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-82hxk"]
May 28 10:17:56.948980 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:56.948952    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-82hxk"]
May 28 10:17:56.960953 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:56.960930    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:17:56.961194 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:56.961170    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-7lh2j" podUID="de8c4353-d680-41c1-b32a-7ac6aca908c4" containerName="redis" containerID="cri-o://dc56c2b3da62571124b9834f1207d5296423b0bafe4a8908ff6b38a12c623465" gracePeriod=30
May 28 10:17:57.101302 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.101271    2556 generic.go:358] "Generic (PLEG): container finished" podID="de8c4353-d680-41c1-b32a-7ac6aca908c4" containerID="dc56c2b3da62571124b9834f1207d5296423b0bafe4a8908ff6b38a12c623465" exitCode=0
May 28 10:17:57.101424 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.101330    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-7lh2j" event={"ID":"de8c4353-d680-41c1-b32a-7ac6aca908c4","Type":"ContainerDied","Data":"dc56c2b3da62571124b9834f1207d5296423b0bafe4a8908ff6b38a12c623465"}
May 28 10:17:57.197209 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.197154    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:17:57.299496 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.299470    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbdbf\" (UniqueName: \"kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf\") pod \"de8c4353-d680-41c1-b32a-7ac6aca908c4\" (UID: \"de8c4353-d680-41c1-b32a-7ac6aca908c4\") "
May 28 10:17:57.301342 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.301322    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf" (OuterVolumeSpecName: "kube-api-access-nbdbf") pod "de8c4353-d680-41c1-b32a-7ac6aca908c4" (UID: "de8c4353-d680-41c1-b32a-7ac6aca908c4"). InnerVolumeSpecName "kube-api-access-nbdbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:17:57.400800 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.400772    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbdbf\" (UniqueName: \"kubernetes.io/projected/de8c4353-d680-41c1-b32a-7ac6aca908c4-kube-api-access-nbdbf\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:17:57.701532 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:57.701505    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" path="/var/lib/kubelet/pods/5c18f00e-b57e-49cb-908f-009554e45b83/volumes"
May 28 10:17:58.104994 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:58.104965    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-7lh2j" event={"ID":"de8c4353-d680-41c1-b32a-7ac6aca908c4","Type":"ContainerDied","Data":"7e139bbb1e7b3437c65270055a5dd5a7f1f075ff9c3e8110c64987aabd58fcb9"}
May 28 10:17:58.105442 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:58.104995    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-7lh2j"
May 28 10:17:58.105442 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:58.105027    2556 scope.go:117] "RemoveContainer" containerID="dc56c2b3da62571124b9834f1207d5296423b0bafe4a8908ff6b38a12c623465"
May 28 10:17:58.121961 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:58.121938    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:17:58.123262 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:58.123245    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-7lh2j"]
May 28 10:17:59.701670 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:17:59.701634    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8c4353-d680-41c1-b32a-7ac6aca908c4" path="/var/lib/kubelet/pods/de8c4353-d680-41c1-b32a-7ac6aca908c4/volumes"
May 28 10:22:34.213193 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.213154    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:22:34.213740 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.213400    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" podUID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" containerName="manager" containerID="cri-o://b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f" gracePeriod=10
May 28 10:22:34.493347 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.493325    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:22:34.592539 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.592503    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rntpz\" (UniqueName: \"kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz\") pod \"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d\" (UID: \"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d\") "
May 28 10:22:34.594594 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.594573    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz" (OuterVolumeSpecName: "kube-api-access-rntpz") pod "e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" (UID: "e7d8f2e4-bcfb-42c4-a5f0-17225eef902d"). InnerVolumeSpecName "kube-api-access-rntpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:22:34.693226 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.693194    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rntpz\" (UniqueName: \"kubernetes.io/projected/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d-kube-api-access-rntpz\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:22:34.913534 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.913439    2556 generic.go:358] "Generic (PLEG): container finished" podID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" containerID="b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f" exitCode=0
May 28 10:22:34.913534 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.913506    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"
May 28 10:22:34.913743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.913524    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" event={"ID":"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d","Type":"ContainerDied","Data":"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"}
May 28 10:22:34.913743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.913570    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv" event={"ID":"e7d8f2e4-bcfb-42c4-a5f0-17225eef902d","Type":"ContainerDied","Data":"82c295d60f35a461f4c53496778dadcbe79e59d29d4fa02b6943a6fc180254f4"}
May 28 10:22:34.913743 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.913588    2556 scope.go:117] "RemoveContainer" containerID="b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"
May 28 10:22:34.922503 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.922487    2556 scope.go:117] "RemoveContainer" containerID="b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"
May 28 10:22:34.922760 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:22:34.922739    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f\": container with ID starting with b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f not found: ID does not exist" containerID="b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"
May 28 10:22:34.922827 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.922768    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f"} err="failed to get container status \"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f\": rpc error: code = NotFound desc = could not find container \"b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f\": container with ID starting with b062a60fe324a5a918ff5d2e0a4c6e77a89b7994c87ef0f22594b82e2103187f not found: ID does not exist"
May 28 10:22:34.936479 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.936450    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:22:34.941596 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:34.941575    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-85c85d8bdf-hkmlv"]
May 28 10:22:35.700983 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:35.700947    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" path="/var/lib/kubelet/pods/e7d8f2e4-bcfb-42c4-a5f0-17225eef902d/volumes"
May 28 10:22:45.918890 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.918853    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919195    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" containerName="manager"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919207    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" containerName="manager"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919225    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" containerName="feast-0"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919230    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" containerName="feast-0"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919237    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" containerName="feast-1"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919243    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" containerName="feast-1"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919255    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8c4353-d680-41c1-b32a-7ac6aca908c4" containerName="redis"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919262    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8c4353-d680-41c1-b32a-7ac6aca908c4" containerName="redis"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919270    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a29b939-0335-4afe-82e8-6adb62d46ee8" containerName="console"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919275    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a29b939-0335-4afe-82e8-6adb62d46ee8" containerName="console"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919322    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c18f00e-b57e-49cb-908f-009554e45b83" containerName="feast-1"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919331    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="de8c4353-d680-41c1-b32a-7ac6aca908c4" containerName="redis"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919338    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a29b939-0335-4afe-82e8-6adb62d46ee8" containerName="console"
May 28 10:22:45.919344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.919345    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7d8f2e4-bcfb-42c4-a5f0-17225eef902d" containerName="manager"
May 28 10:22:45.922156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.922140    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:45.925204 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.925181    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-gvrv5\""
May 28 10:22:45.926216 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.926190    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 10:22:45.926216 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.926208    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 10:22:45.940845 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.940812    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:22:45.983659 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:45.983617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwr8\" (UniqueName: \"kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8\") pod \"feast-operator-controller-manager-cf99db75-lzcwd\" (UID: \"88c37fdc-03f6-4844-9c0f-21761e61df62\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:46.084306 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.084268    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwr8\" (UniqueName: \"kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8\") pod \"feast-operator-controller-manager-cf99db75-lzcwd\" (UID: \"88c37fdc-03f6-4844-9c0f-21761e61df62\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:46.129368 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.129337    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwr8\" (UniqueName: \"kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8\") pod \"feast-operator-controller-manager-cf99db75-lzcwd\" (UID: \"88c37fdc-03f6-4844-9c0f-21761e61df62\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:46.231890 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.231851    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:46.369459 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.369427    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:22:46.372176 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:22:46.372143    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c37fdc_03f6_4844_9c0f_21761e61df62.slice/crio-6c1c317aa150128c8f8d6c44b80d2fc22216edc79bccf3ebfa1f12789276edbb WatchSource:0}: Error finding container 6c1c317aa150128c8f8d6c44b80d2fc22216edc79bccf3ebfa1f12789276edbb: Status 404 returned error can't find the container with id 6c1c317aa150128c8f8d6c44b80d2fc22216edc79bccf3ebfa1f12789276edbb
May 28 10:22:46.373790 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.373774    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:22:46.950583 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:46.950538    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" event={"ID":"88c37fdc-03f6-4844-9c0f-21761e61df62","Type":"ContainerStarted","Data":"6c1c317aa150128c8f8d6c44b80d2fc22216edc79bccf3ebfa1f12789276edbb"}
May 28 10:22:49.961894 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:49.961859    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" event={"ID":"88c37fdc-03f6-4844-9c0f-21761e61df62","Type":"ContainerStarted","Data":"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"}
May 28 10:22:49.962320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:49.961981    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:22:49.984589 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:22:49.984526    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" podStartSLOduration=2.3685097 podStartE2EDuration="4.984511337s" podCreationTimestamp="2026-05-28 10:22:45 +0000 UTC" firstStartedPulling="2026-05-28 10:22:46.373897089 +0000 UTC m=+1049.267465339" lastFinishedPulling="2026-05-28 10:22:48.98989871 +0000 UTC m=+1051.883466976" observedRunningTime="2026-05-28 10:22:49.982956559 +0000 UTC m=+1052.876524829" watchObservedRunningTime="2026-05-28 10:22:49.984511337 +0000 UTC m=+1052.878079637"
May 28 10:23:00.967483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:00.967454    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:23:02.617233 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.617199    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:23:02.622395 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.622374    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.625202 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625179    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 10:23:02.625334 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625184    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-zrrp4\""
May 28 10:23:02.625719 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625692    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 10:23:02.625870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625853    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 10:23:02.625936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625892    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 10:23:02.625936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.625770    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 10:23:02.626147 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.626131    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 10:23:02.635595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.635573    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:23:02.722404 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.722577 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.722577 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.722689 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722570    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz2jc\" (UniqueName: \"kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.722689 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.722689 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.722673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823309 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823281    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823317    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823366    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823402    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz2jc\" (UniqueName: \"kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:23:02.823446    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823456    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823484    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.823784 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:23:02.823530    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls podName:8aa86b69-e2d7-4310-a86c-c9b19e9acc6c nodeName:}" failed. No retries permitted until 2026-05-28 10:23:03.323508905 +0000 UTC m=+1066.217077154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls") pod "feast-simple-feast-setup-664fcfcc58-q5prh" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c") : secret "feast-simple-feast-setup-online-tls" not found
May 28 10:23:02.823784 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:23:02.823642    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:23:02.823784 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:23:02.823704    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls podName:8aa86b69-e2d7-4310-a86c-c9b19e9acc6c nodeName:}" failed. No retries permitted until 2026-05-28 10:23:03.323686673 +0000 UTC m=+1066.217254922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-q5prh" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:23:02.823939 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.823842    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.825864 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.825838    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.825864 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.825858    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:02.833220 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:02.833196    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz2jc\" (UniqueName: \"kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.326635 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.326607    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.326797 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.326671    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.329099 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.329067    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.329208 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.329067    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-q5prh\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.540258 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.540229    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:03.668953 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:03.668930    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:23:03.670900 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:23:03.670872    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8aa86b69_e2d7_4310_a86c_c9b19e9acc6c.slice/crio-d61eec6673c98c4aa6405e8508a7c27f287a3d894c545abe5875e3703c17b730 WatchSource:0}: Error finding container d61eec6673c98c4aa6405e8508a7c27f287a3d894c545abe5875e3703c17b730: Status 404 returned error can't find the container with id d61eec6673c98c4aa6405e8508a7c27f287a3d894c545abe5875e3703c17b730
May 28 10:23:04.007090 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:04.007060    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"d61eec6673c98c4aa6405e8508a7c27f287a3d894c545abe5875e3703c17b730"}
May 28 10:23:17.684950 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:17.684917    2556 scope.go:117] "RemoveContainer" containerID="76a2a09e8562e727399a78334348cf5cee75af27e70d2b6f25d359f422b3c9bc"
May 28 10:23:18.717292 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:18.717120    2556 scope.go:117] "RemoveContainer" containerID="7d140cefb5b024a20fca29777e8f5f9e27ddc742bb39111f4ffd54f5ce7f2379"
May 28 10:23:19.061203 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:19.061165    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"f05db17514e0642d2d5877c051fcb2796c8e24eff41aff076cf7f0598ca36f02"}
May 28 10:23:24.075706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:24.075671    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="f05db17514e0642d2d5877c051fcb2796c8e24eff41aff076cf7f0598ca36f02" exitCode=0
May 28 10:23:24.076082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:24.075746    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"f05db17514e0642d2d5877c051fcb2796c8e24eff41aff076cf7f0598ca36f02"}
May 28 10:23:25.079757 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:25.079716    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"d3d5d1993308c2f37e7f05a77811b5c09354bebbcb7c6b6b487024afd75282d4"}
May 28 10:23:30.096503 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:30.096467    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="d3d5d1993308c2f37e7f05a77811b5c09354bebbcb7c6b6b487024afd75282d4" exitCode=0
May 28 10:23:30.096923 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:30.096538    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"d3d5d1993308c2f37e7f05a77811b5c09354bebbcb7c6b6b487024afd75282d4"}
May 28 10:23:31.103860 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:31.103819    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"dd0e8620a56010d95ecf213275374fa735dd6265a09e4a4f9ad81ec9baed12f6"}
May 28 10:23:31.103860 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:31.103866    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"4c3b9601b3f0fb224887880a426399aa11d4de6c5ac4bb2b6cbcfa30870b568e"}
May 28 10:23:31.104425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:31.103898    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"d5800f9b9cc66ec7501ca5c19915dfe4bb59f6d2bf5ed3e8076716ec9899a224"}
May 28 10:23:31.104425 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:31.103911    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerStarted","Data":"271cb3738a05e879b90437171e51cdf6f59bf8d172f63a9a5376d3fd3070b94e"}
May 28 10:23:31.136473 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:31.136397    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podStartSLOduration=14.004393461 podStartE2EDuration="29.136374472s" podCreationTimestamp="2026-05-28 10:23:02 +0000 UTC" firstStartedPulling="2026-05-28 10:23:03.672704236 +0000 UTC m=+1066.566272485" lastFinishedPulling="2026-05-28 10:23:18.804685247 +0000 UTC m=+1081.698253496" observedRunningTime="2026-05-28 10:23:31.134327597 +0000 UTC m=+1094.027895869" watchObservedRunningTime="2026-05-28 10:23:31.136374472 +0000 UTC m=+1094.029942742"
May 28 10:23:33.541285 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.541244    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.541775 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.541296    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.541775 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.541311    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.541775 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.541322    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.541775 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.541334    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.542104 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.542048    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.542104 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.542085    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.542290 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.542278    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:33.543370 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.543328    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 10:23:33.543370 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.543351    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
May 28 10:23:33.543580 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.543371    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 28 10:23:33.543580 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:33.543455    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 10:23:36.541477 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.541443    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:36.541959 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.541794    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:36.542080 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.542050    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:36.542219 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.542119    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:36.542219 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.542170    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:36.545960 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:36.545946    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:37.125192 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:37.125158    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:23:37.127600 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:23:37.127563    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:24:39.956992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:39.956900    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:24:39.957582 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:39.957337    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="registry" containerID="cri-o://271cb3738a05e879b90437171e51cdf6f59bf8d172f63a9a5376d3fd3070b94e" gracePeriod=30
May 28 10:24:39.957582 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:39.957480    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online" containerID="cri-o://d5800f9b9cc66ec7501ca5c19915dfe4bb59f6d2bf5ed3e8076716ec9899a224" gracePeriod=30
May 28 10:24:39.957706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:39.957577    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui" containerID="cri-o://dd0e8620a56010d95ecf213275374fa735dd6265a09e4a4f9ad81ec9baed12f6" gracePeriod=30
May 28 10:24:39.957706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:39.957623    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="offline" containerID="cri-o://4c3b9601b3f0fb224887880a426399aa11d4de6c5ac4bb2b6cbcfa30870b568e" gracePeriod=30
May 28 10:24:40.451059 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.451027    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:24:40.454788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.454764    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.463456 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.463435    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-q752k\""
May 28 10:24:40.476203 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.476157    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:24:40.547458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gm4h\" (UniqueName: \"kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.547639 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.547639 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.547639 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.547639 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.547798 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.547700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648112 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648079    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648219 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648123    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648219 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648178    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gm4h\" (UniqueName: \"kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648219 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648212    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648242    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648338 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648270    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.648433 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:24:40.648340    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:24:40.648433 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:24:40.648412    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls podName:8bf50332-eeeb-435b-b0b0-db24afd7354e nodeName:}" failed. No retries permitted until 2026-05-28 10:24:41.14838815 +0000 UTC m=+1164.041956411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-rktlv" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 10:24:40.648533 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.648496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.650592 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.650566    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.650696 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.650681    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.650827 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.650805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:40.666274 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:40.666208    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gm4h\" (UniqueName: \"kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:41.152666 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.152627    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:41.154967 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.154947    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-rktlv\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:41.312838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.312807    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="dd0e8620a56010d95ecf213275374fa735dd6265a09e4a4f9ad81ec9baed12f6" exitCode=0
May 28 10:24:41.312838 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.312834    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="d5800f9b9cc66ec7501ca5c19915dfe4bb59f6d2bf5ed3e8076716ec9899a224" exitCode=0
May 28 10:24:41.313035 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.312868    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"dd0e8620a56010d95ecf213275374fa735dd6265a09e4a4f9ad81ec9baed12f6"}
May 28 10:24:41.313035 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.312904    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"d5800f9b9cc66ec7501ca5c19915dfe4bb59f6d2bf5ed3e8076716ec9899a224"}
May 28 10:24:41.364408 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.364385    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:41.506988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:41.506958    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:24:41.508114 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:24:41.508089    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bf50332_eeeb_435b_b0b0_db24afd7354e.slice/crio-98984667814e2ea6af49201918ffbf9a461943034b933486ab0ca48464dedfa9 WatchSource:0}: Error finding container 98984667814e2ea6af49201918ffbf9a461943034b933486ab0ca48464dedfa9: Status 404 returned error can't find the container with id 98984667814e2ea6af49201918ffbf9a461943034b933486ab0ca48464dedfa9
May 28 10:24:42.316788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:42.316753    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"f7df8f2ad987bfed6e2aff8f611697e82091eb8903dc121c5fe634f65e5703e6"}
May 28 10:24:42.316788 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:42.316793    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"98984667814e2ea6af49201918ffbf9a461943034b933486ab0ca48464dedfa9"}
May 28 10:24:46.329211 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:46.329129    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="f7df8f2ad987bfed6e2aff8f611697e82091eb8903dc121c5fe634f65e5703e6" exitCode=0
May 28 10:24:46.329211 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:46.329201    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"f7df8f2ad987bfed6e2aff8f611697e82091eb8903dc121c5fe634f65e5703e6"}
May 28 10:24:47.124917 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:47.124879    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 10:24:47.125091 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:47.124879    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 10:24:47.335701 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:47.335664    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"fdf058dab35b53c269cfcdae857f980810489b32578a6462439672c3c281b800"}
May 28 10:24:52.355412 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:52.355377    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="fdf058dab35b53c269cfcdae857f980810489b32578a6462439672c3c281b800" exitCode=0
May 28 10:24:52.355806 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:52.355453    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"fdf058dab35b53c269cfcdae857f980810489b32578a6462439672c3c281b800"}
May 28 10:24:53.363635 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.363592    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"5c0756cadb35404daef9a0eb09bbf589615b9153c22b2999d9194d792317f8cc"}
May 28 10:24:53.364101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.363647    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"ea4bda7790eeee8c5cefc882be23ec4db3199786c1beeedfea372b0e2f5bc93f"}
May 28 10:24:53.364101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.363662    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"c646ff9975d902e046e35d85cdded3adc68dcf26f6ecfe3be6bcacc5d04f4e51"}
May 28 10:24:53.364101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.363677    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerStarted","Data":"8f69fad84fd319c9910391ebbd776d2e4f80d99d2f12ba87872752a2450ac5e6"}
May 28 10:24:53.364569 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.364543    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:53.364686 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.364584    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:53.364686 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.364598    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:53.364686 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.364610    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:53.366823 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.366784    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
May 28 10:24:53.366960 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.366824    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 10:24:53.366960 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.366839    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused"
May 28 10:24:53.367168 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.367145    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 10:24:53.415305 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:53.415238    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podStartSLOduration=13.415220727 podStartE2EDuration="13.415220727s" podCreationTimestamp="2026-05-28 10:24:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:24:53.411515957 +0000 UTC m=+1176.305084232" watchObservedRunningTime="2026-05-28 10:24:53.415220727 +0000 UTC m=+1176.308788999"
May 28 10:24:56.365516 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:56.365465    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
May 28 10:24:56.365991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:56.365520    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused"
May 28 10:24:56.365991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:56.365461    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 10:24:56.365991 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:56.365648    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 10:24:57.125511 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:57.125456    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 10:24:57.125720 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:57.125528    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 10:24:59.365833 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.365779    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366297 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366052    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366541 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366521    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366649 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366547    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366649 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366555    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366649 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366589    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.366649 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.366618    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.370391 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.370370    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.384937 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.384916    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.385053 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.384944    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.385435 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.385420    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:24:59.387507 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:24:59.387488    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:25:07.124774 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:07.124737    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 28 10:25:07.125154 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:07.124733    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused"
May 28 10:25:07.125154 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:07.124873    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:25:07.125154 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:07.124930    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:25:10.419820 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.419777    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="4c3b9601b3f0fb224887880a426399aa11d4de6c5ac4bb2b6cbcfa30870b568e" exitCode=137
May 28 10:25:10.419820 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.419803    2556 generic.go:358] "Generic (PLEG): container finished" podID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerID="271cb3738a05e879b90437171e51cdf6f59bf8d172f63a9a5376d3fd3070b94e" exitCode=137
May 28 10:25:10.420226 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.419840    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"4c3b9601b3f0fb224887880a426399aa11d4de6c5ac4bb2b6cbcfa30870b568e"}
May 28 10:25:10.420226 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.419875    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"271cb3738a05e879b90437171e51cdf6f59bf8d172f63a9a5376d3fd3070b94e"}
May 28 10:25:10.599628 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.599608    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:25:10.709376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709303    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.709376 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709351    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.709595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709421    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.709595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709454    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.709595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709503    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.709595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.709551    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz2jc\" (UniqueName: \"kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc\") pod \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\" (UID: \"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c\") "
May 28 10:25:10.710260 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.710225    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data" (OuterVolumeSpecName: "feast-data") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:25:10.711870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.711841    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls" (OuterVolumeSpecName: "online-tls") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:25:10.711870 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.711858    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc" (OuterVolumeSpecName: "kube-api-access-dz2jc") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "kube-api-access-dz2jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:25:10.712043 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.711865    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:25:10.712043 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.711998    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:25:10.712181 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.712165    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" (UID: "8aa86b69-e2d7-4310-a86c-c9b19e9acc6c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:25:10.810286 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810255    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:10.810286 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810285    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:10.810286 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810296    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz2jc\" (UniqueName: \"kubernetes.io/projected/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-kube-api-access-dz2jc\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:10.810445 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810305    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:10.810445 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810314    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:10.810445 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:10.810322    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:25:11.425529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.425491    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh" event={"ID":"8aa86b69-e2d7-4310-a86c-c9b19e9acc6c","Type":"ContainerDied","Data":"d61eec6673c98c4aa6405e8508a7c27f287a3d894c545abe5875e3703c17b730"}
May 28 10:25:11.425529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.425532    2556 scope.go:117] "RemoveContainer" containerID="dd0e8620a56010d95ecf213275374fa735dd6265a09e4a4f9ad81ec9baed12f6"
May 28 10:25:11.426082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.425541    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"
May 28 10:25:11.434665 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.434649    2556 scope.go:117] "RemoveContainer" containerID="4c3b9601b3f0fb224887880a426399aa11d4de6c5ac4bb2b6cbcfa30870b568e"
May 28 10:25:11.441627 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.441610    2556 scope.go:117] "RemoveContainer" containerID="d5800f9b9cc66ec7501ca5c19915dfe4bb59f6d2bf5ed3e8076716ec9899a224"
May 28 10:25:11.448675 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.448652    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:25:11.449071 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.448997    2556 scope.go:117] "RemoveContainer" containerID="271cb3738a05e879b90437171e51cdf6f59bf8d172f63a9a5376d3fd3070b94e"
May 28 10:25:11.452141 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.452098    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-q5prh"]
May 28 10:25:11.456472 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.456456    2556 scope.go:117] "RemoveContainer" containerID="d3d5d1993308c2f37e7f05a77811b5c09354bebbcb7c6b6b487024afd75282d4"
May 28 10:25:11.462885 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.462872    2556 scope.go:117] "RemoveContainer" containerID="f05db17514e0642d2d5877c051fcb2796c8e24eff41aff076cf7f0598ca36f02"
May 28 10:25:11.701487 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:25:11.701411    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" path="/var/lib/kubelet/pods/8aa86b69-e2d7-4310-a86c-c9b19e9acc6c/volumes"
May 28 10:26:02.159110 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.159073    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:26:02.165116 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165083    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="offline"
May 28 10:26:02.165275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165240    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="offline"
May 28 10:26:02.165275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165269    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="feast-init"
May 28 10:26:02.165275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165276    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="feast-init"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165282    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="registry"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165288    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="registry"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165306    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165312    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165319    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="feast-apply"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165325    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="feast-apply"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165338    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui"
May 28 10:26:02.165413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165346    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui"
May 28 10:26:02.165761 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165631    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="online"
May 28 10:26:02.165761 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165642    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="offline"
May 28 10:26:02.165761 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165656    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="ui"
May 28 10:26:02.165761 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.165664    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8aa86b69-e2d7-4310-a86c-c9b19e9acc6c" containerName="registry"
May 28 10:26:02.169380 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.169356    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.172865 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172842    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 10:26:02.172992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172847    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 10:26:02.172992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172847    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-s2h2x\""
May 28 10:26:02.172992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172967    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 10:26:02.173196 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172880    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 10:26:02.173196 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.172861    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 10:26:02.173333 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.173318    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 10:26:02.178294 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.178274    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:26:02.212232 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9wc\" (UniqueName: \"kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.212386 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.212386 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.212386 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212315    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.212386 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.212539 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.212394    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.312959 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.312922    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9wc\" (UniqueName: \"kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.312977    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313027    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313077    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313110    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313136    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313694 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313652    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.313872 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.313852    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.315828 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.315800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.315920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.315832    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.315920 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.315861    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.321757 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.321721    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9wc\" (UniqueName: \"kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc\") pod \"feast-simple-feast-remote-setup-5cff94746b-dqc8q\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.479588 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.479551    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:02.606997 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:02.606967    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:26:02.609593 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:26:02.609567    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f823184_bec9_469e_afdb_f00dbcf65274.slice/crio-6e14cb77ac11d41c6459168a7d755027141ed4f1f757afcc4a6a41e48aeaa231 WatchSource:0}: Error finding container 6e14cb77ac11d41c6459168a7d755027141ed4f1f757afcc4a6a41e48aeaa231: Status 404 returned error can't find the container with id 6e14cb77ac11d41c6459168a7d755027141ed4f1f757afcc4a6a41e48aeaa231
May 28 10:26:03.585841 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:03.585804    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"}
May 28 10:26:03.585841 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:03.585846    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"6e14cb77ac11d41c6459168a7d755027141ed4f1f757afcc4a6a41e48aeaa231"}
May 28 10:26:07.600463 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:07.600427    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f823184-bec9-469e-afdb-f00dbcf65274" containerID="d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337" exitCode=0
May 28 10:26:07.600830 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:07.600500    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"}
May 28 10:26:08.605190 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:08.605155    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"}
May 28 10:26:13.619542 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:13.619507    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f823184-bec9-469e-afdb-f00dbcf65274" containerID="cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309" exitCode=0
May 28 10:26:13.620035 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:13.619582    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"}
May 28 10:26:14.626107 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:14.626064    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"}
May 28 10:26:14.626492 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:14.626126    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"}
May 28 10:26:14.626492 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:14.626144    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerStarted","Data":"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"}
May 28 10:26:14.651679 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:14.651587    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podStartSLOduration=12.651568364 podStartE2EDuration="12.651568364s" podCreationTimestamp="2026-05-28 10:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:26:14.649182731 +0000 UTC m=+1257.542751002" watchObservedRunningTime="2026-05-28 10:26:14.651568364 +0000 UTC m=+1257.545136636"
May 28 10:26:17.480273 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.480231    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:17.480660 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.480289    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:17.480660 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.480307    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:17.482232 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.482204    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.29:8816: connect: connection refused"
May 28 10:26:17.482323 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.482243    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 10:26:17.482323 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:17.482250    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 10:26:20.480797 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.480767    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.481215 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.480879    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.481215 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.481200    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.481331 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.481231    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.481517 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.481495    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.481676 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.481662    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.484906 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.484886    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.648528 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.648495    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:26:20.651413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:26:20.651392    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:27:23.242616 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.242585    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:27:23.243217 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.242984    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online" containerID="cri-o://ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58" gracePeriod=30
May 28 10:27:23.243217 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.243147    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="offline" containerID="cri-o://aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5" gracePeriod=30
May 28 10:27:23.243217 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.243124    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui" containerID="cri-o://ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5" gracePeriod=30
May 28 10:27:23.383755 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.383724    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:27:23.384284 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.384040    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry" containerID="cri-o://8f69fad84fd319c9910391ebbd776d2e4f80d99d2f12ba87872752a2450ac5e6" gracePeriod=30
May 28 10:27:23.384284 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.384082    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" containerID="cri-o://5c0756cadb35404daef9a0eb09bbf589615b9153c22b2999d9194d792317f8cc" gracePeriod=30
May 28 10:27:23.384284 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.384117    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" containerID="cri-o://c646ff9975d902e046e35d85cdded3adc68dcf26f6ecfe3be6bcacc5d04f4e51" gracePeriod=30
May 28 10:27:23.384284 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.384136    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline" containerID="cri-o://ea4bda7790eeee8c5cefc882be23ec4db3199786c1beeedfea372b0e2f5bc93f" gracePeriod=30
May 28 10:27:23.838089 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.838048    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f823184-bec9-469e-afdb-f00dbcf65274" containerID="ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5" exitCode=0
May 28 10:27:23.838285 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:23.838090    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"}
May 28 10:27:24.843932 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.843898    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f823184-bec9-469e-afdb-f00dbcf65274" containerID="ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58" exitCode=0
May 28 10:27:24.844357 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.843959    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"}
May 28 10:27:24.846365 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.846346    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="5c0756cadb35404daef9a0eb09bbf589615b9153c22b2999d9194d792317f8cc" exitCode=0
May 28 10:27:24.846365 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.846363    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="c646ff9975d902e046e35d85cdded3adc68dcf26f6ecfe3be6bcacc5d04f4e51" exitCode=0
May 28 10:27:24.846507 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.846413    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"5c0756cadb35404daef9a0eb09bbf589615b9153c22b2999d9194d792317f8cc"}
May 28 10:27:24.846507 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:24.846444    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"c646ff9975d902e046e35d85cdded3adc68dcf26f6ecfe3be6bcacc5d04f4e51"}
May 28 10:27:29.385657 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:29.385617    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 10:27:29.386064 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:29.385678    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 10:27:30.481462 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:30.481416    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 10:27:30.648691 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:30.648650    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 10:27:39.384992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:39.384909    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 10:27:39.384992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:39.384914    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 10:27:40.481399 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:40.481354    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 10:27:40.649154 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:40.649115    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 10:27:49.385620 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:49.385574    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused"
May 28 10:27:49.386132 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:49.385656    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
May 28 10:27:49.386132 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:49.385686    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:27:49.386132 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:49.385788    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:27:50.481972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:50.481928    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused"
May 28 10:27:50.482395 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:50.482084    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:27:50.649518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:50.649476    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
May 28 10:27:50.649660 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:50.649589    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:27:53.894387 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.894368    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:27:53.929296 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.929268    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g9wc\" (UniqueName: \"kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.929449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.929317    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.929449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.929341    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.930137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.929858    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.930137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.929929    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.930137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.930028    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls\") pod \"9f823184-bec9-469e-afdb-f00dbcf65274\" (UID: \"9f823184-bec9-469e-afdb-f00dbcf65274\") "
May 28 10:27:53.931097 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.931051    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data" (OuterVolumeSpecName: "feast-data") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:27:53.931910 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.931857    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:27:53.932344 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.932306    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:53.932794 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.932747    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls" (OuterVolumeSpecName: "online-tls") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:53.933173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.933112    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc" (OuterVolumeSpecName: "kube-api-access-5g9wc") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "kube-api-access-5g9wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:27:53.934617 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.934592    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9f823184-bec9-469e-afdb-f00dbcf65274" (UID: "9f823184-bec9-469e-afdb-f00dbcf65274"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:53.936540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.936507    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="ea4bda7790eeee8c5cefc882be23ec4db3199786c1beeedfea372b0e2f5bc93f" exitCode=137
May 28 10:27:53.936540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.936538    2556 generic.go:358] "Generic (PLEG): container finished" podID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerID="8f69fad84fd319c9910391ebbd776d2e4f80d99d2f12ba87872752a2450ac5e6" exitCode=137
May 28 10:27:53.936695 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.936680    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"ea4bda7790eeee8c5cefc882be23ec4db3199786c1beeedfea372b0e2f5bc93f"}
May 28 10:27:53.936750 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.936720    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"8f69fad84fd319c9910391ebbd776d2e4f80d99d2f12ba87872752a2450ac5e6"}
May 28 10:27:53.939449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.939418    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f823184-bec9-469e-afdb-f00dbcf65274" containerID="aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5" exitCode=137
May 28 10:27:53.939554 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.939479    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"}
May 28 10:27:53.939554 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.939506    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q" event={"ID":"9f823184-bec9-469e-afdb-f00dbcf65274","Type":"ContainerDied","Data":"6e14cb77ac11d41c6459168a7d755027141ed4f1f757afcc4a6a41e48aeaa231"}
May 28 10:27:53.939554 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.939528    2556 scope.go:117] "RemoveContainer" containerID="ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"
May 28 10:27:53.939714 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.939685    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"
May 28 10:27:53.951849 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.951419    2556 scope.go:117] "RemoveContainer" containerID="aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"
May 28 10:27:53.961100 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.961081    2556 scope.go:117] "RemoveContainer" containerID="ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"
May 28 10:27:53.968962 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.968934    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:27:53.969308 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.969243    2556 scope.go:117] "RemoveContainer" containerID="cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"
May 28 10:27:53.972038 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.972016    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-dqc8q"]
May 28 10:27:53.977791 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.977772    2556 scope.go:117] "RemoveContainer" containerID="d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"
May 28 10:27:53.985241 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.985221    2556 scope.go:117] "RemoveContainer" containerID="ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"
May 28 10:27:53.985505 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:27:53.985485    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5\": container with ID starting with ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5 not found: ID does not exist" containerID="ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"
May 28 10:27:53.985578 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.985518    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5"} err="failed to get container status \"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5\": rpc error: code = NotFound desc = could not find container \"ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5\": container with ID starting with ac963abb0820382c24afebaa66dc71e24c97d6662d8ada90ca01391c49f2e3b5 not found: ID does not exist"
May 28 10:27:53.985578 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.985545    2556 scope.go:117] "RemoveContainer" containerID="aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"
May 28 10:27:53.985808 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:27:53.985791    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5\": container with ID starting with aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5 not found: ID does not exist" containerID="aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"
May 28 10:27:53.985852 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.985818    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5"} err="failed to get container status \"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5\": rpc error: code = NotFound desc = could not find container \"aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5\": container with ID starting with aa22e912cca29309b53072e171b7e026bcf7fd59b1522ef165438d84ee1254e5 not found: ID does not exist"
May 28 10:27:53.985852 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.985835    2556 scope.go:117] "RemoveContainer" containerID="ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"
May 28 10:27:53.986133 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:27:53.986112    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58\": container with ID starting with ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58 not found: ID does not exist" containerID="ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"
May 28 10:27:53.986186 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.986142    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58"} err="failed to get container status \"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58\": rpc error: code = NotFound desc = could not find container \"ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58\": container with ID starting with ac28fa8bf46188fa18d9c80f54a89339e5b2740277080d3359714d56349e3a58 not found: ID does not exist"
May 28 10:27:53.986186 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.986164    2556 scope.go:117] "RemoveContainer" containerID="cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"
May 28 10:27:53.986416 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:27:53.986401    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309\": container with ID starting with cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309 not found: ID does not exist" containerID="cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"
May 28 10:27:53.986478 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.986419    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309"} err="failed to get container status \"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309\": rpc error: code = NotFound desc = could not find container \"cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309\": container with ID starting with cd0cb7d325c694c01bf7c151658bb6afc779c13c34470d4b07719278fcd4f309 not found: ID does not exist"
May 28 10:27:53.986478 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.986432    2556 scope.go:117] "RemoveContainer" containerID="d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"
May 28 10:27:53.986664 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:27:53.986646    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337\": container with ID starting with d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337 not found: ID does not exist" containerID="d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"
May 28 10:27:53.986708 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:53.986669    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337"} err="failed to get container status \"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337\": rpc error: code = NotFound desc = could not find container \"d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337\": container with ID starting with d21422faf0fd26cc755fed5e8d47ab662e5410943b12533de926279fbe589337 not found: ID does not exist"
May 28 10:27:54.027525 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.027507    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:27:54.030959 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030942    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g9wc\" (UniqueName: \"kubernetes.io/projected/9f823184-bec9-469e-afdb-f00dbcf65274-kube-api-access-5g9wc\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.031037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030962    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.031037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030972    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.031037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030983    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9f823184-bec9-469e-afdb-f00dbcf65274-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.031037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030991    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9f823184-bec9-469e-afdb-f00dbcf65274-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.031037 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.030999    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9f823184-bec9-469e-afdb-f00dbcf65274-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.131426 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131400    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.131531 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131432    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gm4h\" (UniqueName: \"kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.131531 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131473    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.131531 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131499    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.131678 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131533    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.131730 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.131693    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls\") pod \"8bf50332-eeeb-435b-b0b0-db24afd7354e\" (UID: \"8bf50332-eeeb-435b-b0b0-db24afd7354e\") "
May 28 10:27:54.132109 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.132069    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data" (OuterVolumeSpecName: "feast-data") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:27:54.133567 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.133541    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:54.133659 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.133565    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:54.133659 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.133618    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:54.133895 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.133878    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls" (OuterVolumeSpecName: "online-tls") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:27:54.133965 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.133901    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h" (OuterVolumeSpecName: "kube-api-access-9gm4h") pod "8bf50332-eeeb-435b-b0b0-db24afd7354e" (UID: "8bf50332-eeeb-435b-b0b0-db24afd7354e"). InnerVolumeSpecName "kube-api-access-9gm4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:27:54.232412 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232390    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.232502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232414    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gm4h\" (UniqueName: \"kubernetes.io/projected/8bf50332-eeeb-435b-b0b0-db24afd7354e-kube-api-access-9gm4h\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.232502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232429    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8bf50332-eeeb-435b-b0b0-db24afd7354e-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.232502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232441    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.232502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232453    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.232502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.232464    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8bf50332-eeeb-435b-b0b0-db24afd7354e-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:27:54.944916 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.944889    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"
May 28 10:27:54.944916 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.944899    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv" event={"ID":"8bf50332-eeeb-435b-b0b0-db24afd7354e","Type":"ContainerDied","Data":"98984667814e2ea6af49201918ffbf9a461943034b933486ab0ca48464dedfa9"}
May 28 10:27:54.945528 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.944951    2556 scope.go:117] "RemoveContainer" containerID="5c0756cadb35404daef9a0eb09bbf589615b9153c22b2999d9194d792317f8cc"
May 28 10:27:54.953744 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.953728    2556 scope.go:117] "RemoveContainer" containerID="ea4bda7790eeee8c5cefc882be23ec4db3199786c1beeedfea372b0e2f5bc93f"
May 28 10:27:54.960486 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.960471    2556 scope.go:117] "RemoveContainer" containerID="c646ff9975d902e046e35d85cdded3adc68dcf26f6ecfe3be6bcacc5d04f4e51"
May 28 10:27:54.966993 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.966971    2556 scope.go:117] "RemoveContainer" containerID="8f69fad84fd319c9910391ebbd776d2e4f80d99d2f12ba87872752a2450ac5e6"
May 28 10:27:54.969978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.969958    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:27:54.974535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.974508    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-rktlv"]
May 28 10:27:54.974914 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.974901    2556 scope.go:117] "RemoveContainer" containerID="fdf058dab35b53c269cfcdae857f980810489b32578a6462439672c3c281b800"
May 28 10:27:54.981374 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:54.981358    2556 scope.go:117] "RemoveContainer" containerID="f7df8f2ad987bfed6e2aff8f611697e82091eb8903dc121c5fe634f65e5703e6"
May 28 10:27:55.700803 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:55.700771    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" path="/var/lib/kubelet/pods/8bf50332-eeeb-435b-b0b0-db24afd7354e/volumes"
May 28 10:27:55.701405 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:27:55.701391    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" path="/var/lib/kubelet/pods/9f823184-bec9-469e-afdb-f00dbcf65274/volumes"
May 28 10:28:12.540889 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.540852    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:28:12.541314 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.541103    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" podUID="88c37fdc-03f6-4844-9c0f-21761e61df62" containerName="manager" containerID="cri-o://4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36" gracePeriod=10
May 28 10:28:12.777202 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.777181    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:28:12.894594 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.894528    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbwr8\" (UniqueName: \"kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8\") pod \"88c37fdc-03f6-4844-9c0f-21761e61df62\" (UID: \"88c37fdc-03f6-4844-9c0f-21761e61df62\") "
May 28 10:28:12.896616 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.896593    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8" (OuterVolumeSpecName: "kube-api-access-gbwr8") pod "88c37fdc-03f6-4844-9c0f-21761e61df62" (UID: "88c37fdc-03f6-4844-9c0f-21761e61df62"). InnerVolumeSpecName "kube-api-access-gbwr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:28:12.995246 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:12.995221    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbwr8\" (UniqueName: \"kubernetes.io/projected/88c37fdc-03f6-4844-9c0f-21761e61df62-kube-api-access-gbwr8\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:28:13.001832 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.001806    2556 generic.go:358] "Generic (PLEG): container finished" podID="88c37fdc-03f6-4844-9c0f-21761e61df62" containerID="4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36" exitCode=0
May 28 10:28:13.001936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.001868    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"
May 28 10:28:13.001936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.001897    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" event={"ID":"88c37fdc-03f6-4844-9c0f-21761e61df62","Type":"ContainerDied","Data":"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"}
May 28 10:28:13.001936 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.001930    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd" event={"ID":"88c37fdc-03f6-4844-9c0f-21761e61df62","Type":"ContainerDied","Data":"6c1c317aa150128c8f8d6c44b80d2fc22216edc79bccf3ebfa1f12789276edbb"}
May 28 10:28:13.002093 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.001947    2556 scope.go:117] "RemoveContainer" containerID="4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"
May 28 10:28:13.009577 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.009545    2556 scope.go:117] "RemoveContainer" containerID="4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"
May 28 10:28:13.009892 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:28:13.009873    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36\": container with ID starting with 4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36 not found: ID does not exist" containerID="4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"
May 28 10:28:13.009961 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.009900    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36"} err="failed to get container status \"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36\": rpc error: code = NotFound desc = could not find container \"4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36\": container with ID starting with 4f30ef618991d21d4d7f8bb3b44e22a9d4edff0441debf207b8aee2d5d5fab36 not found: ID does not exist"
May 28 10:28:13.023450 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.023431    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:28:13.026762 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.026740    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-lzcwd"]
May 28 10:28:13.701333 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:13.701299    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c37fdc-03f6-4844-9c0f-21761e61df62" path="/var/lib/kubelet/pods/88c37fdc-03f6-4844-9c0f-21761e61df62/volumes"
May 28 10:28:17.020517 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020481    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"]
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020776    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="feast-apply"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020787    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="feast-apply"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020796    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c37fdc-03f6-4844-9c0f-21761e61df62" containerName="manager"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020801    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c37fdc-03f6-4844-9c0f-21761e61df62" containerName="manager"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020809    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="feast-init"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020814    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="feast-init"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020820    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020825    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020835    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="offline"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020840    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="offline"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020845    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020850    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020855    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020860    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020865    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020871    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020879    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="feast-apply"
May 28 10:28:17.020882 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020884    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="feast-apply"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020894    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020900    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020905    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020909    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020915    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="feast-init"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020919    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="feast-init"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020965    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="88c37fdc-03f6-4844-9c0f-21761e61df62" containerName="manager"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020973    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="offline"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020979    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="offline"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020985    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="online"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020990    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="online"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.020996    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="ui"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.021017    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f823184-bec9-469e-afdb-f00dbcf65274" containerName="ui"
May 28 10:28:17.021430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.021025    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bf50332-eeeb-435b-b0b0-db24afd7354e" containerName="registry"
May 28 10:28:17.023681 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.023663    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:17.026150 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.026131    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 10:28:17.031615 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.031586    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 10:28:17.031763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.031645    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-gvrv5\""
May 28 10:28:17.034270 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.034243    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"]
May 28 10:28:17.134075 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.134037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p744q\" (UniqueName: \"kubernetes.io/projected/2b7024d0-3790-430f-ad6e-1eeaeb7aa054-kube-api-access-p744q\") pod \"feast-operator-controller-manager-cf99db75-bjsb2\" (UID: \"2b7024d0-3790-430f-ad6e-1eeaeb7aa054\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:17.234876 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.234843    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p744q\" (UniqueName: \"kubernetes.io/projected/2b7024d0-3790-430f-ad6e-1eeaeb7aa054-kube-api-access-p744q\") pod \"feast-operator-controller-manager-cf99db75-bjsb2\" (UID: \"2b7024d0-3790-430f-ad6e-1eeaeb7aa054\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:17.244088 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.244063    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p744q\" (UniqueName: \"kubernetes.io/projected/2b7024d0-3790-430f-ad6e-1eeaeb7aa054-kube-api-access-p744q\") pod \"feast-operator-controller-manager-cf99db75-bjsb2\" (UID: \"2b7024d0-3790-430f-ad6e-1eeaeb7aa054\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:17.339918 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.339839    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:17.465967 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.465933    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"]
May 28 10:28:17.469040 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:28:17.468998    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7024d0_3790_430f_ad6e_1eeaeb7aa054.slice/crio-e3ded32d0ee6bb52c53814b8ccc44c020f03b41c3b09b31fa202e7fd58034069 WatchSource:0}: Error finding container e3ded32d0ee6bb52c53814b8ccc44c020f03b41c3b09b31fa202e7fd58034069: Status 404 returned error can't find the container with id e3ded32d0ee6bb52c53814b8ccc44c020f03b41c3b09b31fa202e7fd58034069
May 28 10:28:17.470713 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:17.470699    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:28:18.020552 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:18.020517    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2" event={"ID":"2b7024d0-3790-430f-ad6e-1eeaeb7aa054","Type":"ContainerStarted","Data":"96b4c113824e9b22afab1b9d03a6cae7833d705352d56d3660f90615c30925cf"}
May 28 10:28:18.020552 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:18.020554    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2" event={"ID":"2b7024d0-3790-430f-ad6e-1eeaeb7aa054","Type":"ContainerStarted","Data":"e3ded32d0ee6bb52c53814b8ccc44c020f03b41c3b09b31fa202e7fd58034069"}
May 28 10:28:18.020978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:18.020644    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:18.039196 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:18.039154    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2" podStartSLOduration=1.039143601 podStartE2EDuration="1.039143601s" podCreationTimestamp="2026-05-28 10:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:18.037445259 +0000 UTC m=+1380.931013528" watchObservedRunningTime="2026-05-28 10:28:18.039143601 +0000 UTC m=+1380.932711900"
May 28 10:28:29.026247 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:29.026216    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-bjsb2"
May 28 10:28:33.325690 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.325650    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:28:33.331255 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.331234    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.333933 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.333911    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 10:28:33.334115 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.334096    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 10:28:33.334328 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.334314    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8zhmh\""
May 28 10:28:33.334656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.334637    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 10:28:33.334913 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.334895    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 10:28:33.334987 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.334941    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 10:28:33.335174 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.335158    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 10:28:33.342271 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.342246    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:28:33.365276 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.365378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.365378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.365490 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.365490 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.365575 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.365508    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhc5\" (UniqueName: \"kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.465939 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.465910    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.465944    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhc5\" (UniqueName: \"kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.465976    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.466039    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466078 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:28:33.466070    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 10:28:33.466292 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.466082    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466292 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:28:33.466150    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls podName:832a91ad-7c24-477a-b1ed-bb23a38c956e nodeName:}" failed. No retries permitted until 2026-05-28 10:28:33.966130082 +0000 UTC m=+1396.859698331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls") pod "feast-simple-feast-setup-664fcfcc58-mmsqq" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e") : secret "feast-simple-feast-setup-online-tls" not found
May 28 10:28:33.466292 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.466176    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.466535 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.466509    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.468630 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.468602    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.468732 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.468610    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.468732 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.468671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.492444 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.492419    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhc5\" (UniqueName: \"kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.970216 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.970186    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:33.972270 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:33.972248    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-mmsqq\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:34.255512 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:34.255421    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:34.382561 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:34.382537    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:28:34.384635 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:28:34.384606    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod832a91ad_7c24_477a_b1ed_bb23a38c956e.slice/crio-45c604d8313d302ffdcf5d41bff34f3ed7eb6796ae1c3a59c41c8323accac916 WatchSource:0}: Error finding container 45c604d8313d302ffdcf5d41bff34f3ed7eb6796ae1c3a59c41c8323accac916: Status 404 returned error can't find the container with id 45c604d8313d302ffdcf5d41bff34f3ed7eb6796ae1c3a59c41c8323accac916
May 28 10:28:35.070847 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:35.070810    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"146e32e3be108eba583a3a00f451a315ebee2cba02a72cf4b39690eff87e4354"}
May 28 10:28:35.071155 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:35.070852    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"45c604d8313d302ffdcf5d41bff34f3ed7eb6796ae1c3a59c41c8323accac916"}
May 28 10:28:39.083504 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:39.083464    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="146e32e3be108eba583a3a00f451a315ebee2cba02a72cf4b39690eff87e4354" exitCode=0
May 28 10:28:39.083902 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:39.083537    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"146e32e3be108eba583a3a00f451a315ebee2cba02a72cf4b39690eff87e4354"}
May 28 10:28:40.089092 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:40.089049    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"23238932fd16a460878c5f769f7e020a0cdd04acf5c0b19478ced8cdc81322b2"}
May 28 10:28:45.112880 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:45.112849    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="23238932fd16a460878c5f769f7e020a0cdd04acf5c0b19478ced8cdc81322b2" exitCode=0
May 28 10:28:45.113261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:45.112916    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"23238932fd16a460878c5f769f7e020a0cdd04acf5c0b19478ced8cdc81322b2"}
May 28 10:28:46.120476 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.120434    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"d61cf7a66564ea865dc94352d40eca82876a9e619469dcb465a8465a15908966"}
May 28 10:28:46.120476 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.120480    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"116dc1b0266c218c3fed884f94a145975239555675621a1ef64d8efa1788fb51"}
May 28 10:28:46.121025 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.120494    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"1f226ea611b06c02799936b40dbe3bce9d6536c3868e1357c6506026bf4c939d"}
May 28 10:28:46.121025 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.120507    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerStarted","Data":"038ec36c3254c72122739850336d41086597caf89b3f4aa474687904afece5e3"}
May 28 10:28:46.147987 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.147930    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podStartSLOduration=13.147913337 podStartE2EDuration="13.147913337s" podCreationTimestamp="2026-05-28 10:28:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:28:46.146278307 +0000 UTC m=+1409.039846574" watchObservedRunningTime="2026-05-28 10:28:46.147913337 +0000 UTC m=+1409.041481607"
May 28 10:28:46.255673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.255595    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:46.255673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.255653    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:46.255673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.255668    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:46.255673 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.255680    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:46.258083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.257836    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.31:8816: connect: connection refused"
May 28 10:28:46.258083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.257867    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 28 10:28:46.258083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.257904    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 28 10:28:46.258083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:46.257973    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 28 10:28:49.256214 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:49.256165    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 28 10:28:49.256725 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:49.256229    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 28 10:28:49.256725 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:49.256227    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 28 10:28:49.256725 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:49.256166    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.31:8816: connect: connection refused"
May 28 10:28:52.256467 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.256440    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:52.257042 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.256999    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:52.257149 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.257051    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:52.257149 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.257127    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:52.257249 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.257216    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:52.261024 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:52.260995    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.148725 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.148693    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.148913 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.148733    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.148913 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.148748    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.149138 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.149117    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.149378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.149358    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:28:53.151648 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:28:53.151632    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:29:54.883025 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:54.882971    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:29:54.883469 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:54.883328    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry" containerID="cri-o://038ec36c3254c72122739850336d41086597caf89b3f4aa474687904afece5e3" gracePeriod=30
May 28 10:29:54.883469 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:54.883409    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline" containerID="cri-o://116dc1b0266c218c3fed884f94a145975239555675621a1ef64d8efa1788fb51" gracePeriod=30
May 28 10:29:54.883469 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:54.883435    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" containerID="cri-o://1f226ea611b06c02799936b40dbe3bce9d6536c3868e1357c6506026bf4c939d" gracePeriod=30
May 28 10:29:54.883469 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:54.883377    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" containerID="cri-o://d61cf7a66564ea865dc94352d40eca82876a9e619469dcb465a8465a15908966" gracePeriod=30
May 28 10:29:55.305139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.305104    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:29:55.309416 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.309393    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.312449 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.312419    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8g5hs\""
May 28 10:29:55.317696 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317671    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.317820 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.317820 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.317935 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.317935 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwq62\" (UniqueName: \"kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.318048 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.317954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.332504 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.332436    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:29:55.341908 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.341878    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="d61cf7a66564ea865dc94352d40eca82876a9e619469dcb465a8465a15908966" exitCode=0
May 28 10:29:55.342071 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.341947    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"d61cf7a66564ea865dc94352d40eca82876a9e619469dcb465a8465a15908966"}
May 28 10:29:55.418723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418693    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.418723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418726    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.418978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418744    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwq62\" (UniqueName: \"kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.418978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418777    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.418978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418821    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.418978 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.418840    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.419339 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.419312    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.421433 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.421402    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.421709 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.421686    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.421752 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.421703    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.421798 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.421750    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.430100 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.430081    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwq62\" (UniqueName: \"kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62\") pod \"feast-simple-feast-setup-664fcfcc58-m7sbn\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.619039 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.618988    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:29:55.754275 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:55.754241    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:29:55.757283 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:29:55.757256    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f0e8bd6_bf66_4a12_afd3_a78db2f919dd.slice/crio-57c767ea483ef488292881a8e5b48c43f87cb3531da94a4b04e0af60ac08f685 WatchSource:0}: Error finding container 57c767ea483ef488292881a8e5b48c43f87cb3531da94a4b04e0af60ac08f685: Status 404 returned error can't find the container with id 57c767ea483ef488292881a8e5b48c43f87cb3531da94a4b04e0af60ac08f685
May 28 10:29:56.346400 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:56.346364    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"}
May 28 10:29:56.346400 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:56.346402    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"57c767ea483ef488292881a8e5b48c43f87cb3531da94a4b04e0af60ac08f685"}
May 28 10:29:56.349065 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:56.349039    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="1f226ea611b06c02799936b40dbe3bce9d6536c3868e1357c6506026bf4c939d" exitCode=0
May 28 10:29:56.349179 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:29:56.349106    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"1f226ea611b06c02799936b40dbe3bce9d6536c3868e1357c6506026bf4c939d"}
May 28 10:30:00.362726 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:00.362693    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a" exitCode=0
May 28 10:30:00.363069 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:00.362767    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"}
May 28 10:30:01.367085 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:01.367052    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"}
May 28 10:30:03.149261 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:03.149217    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 28 10:30:03.149644 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:03.149220    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 28 10:30:06.383083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:06.383050    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a" exitCode=0
May 28 10:30:06.383529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:06.383130    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"}
May 28 10:30:07.390679 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.390639    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"}
May 28 10:30:07.391156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.390692    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"}
May 28 10:30:07.391156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.390706    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"}
May 28 10:30:07.391156 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.390718    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerStarted","Data":"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"}
May 28 10:30:07.415044 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.414966    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podStartSLOduration=12.414945737 podStartE2EDuration="12.414945737s" podCreationTimestamp="2026-05-28 10:29:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:30:07.414504512 +0000 UTC m=+1490.308072782" watchObservedRunningTime="2026-05-28 10:30:07.414945737 +0000 UTC m=+1490.308514105"
May 28 10:30:07.619558 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.619472    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:07.619558 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.619518    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:07.619558 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.619533    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:07.619558 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.619546    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:07.621726 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.621685    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
May 28 10:30:07.621726 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.621702    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
May 28 10:30:07.621934 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.621777    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
May 28 10:30:07.621934 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:07.621876    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
May 28 10:30:10.620101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:10.620040    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
May 28 10:30:10.620608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:10.620114    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
May 28 10:30:10.620608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:10.620054    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
May 28 10:30:10.620608 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:10.620056    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
May 28 10:30:13.149360 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.149313    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 28 10:30:13.149360 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.149343    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 28 10:30:13.620274 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.620246    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.620477 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.620410    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.620653 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.620636    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621057 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621027    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621065    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621077    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621292 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621234    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621430 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621414    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.621483 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.621461    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:13.624981 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:13.624963    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:14.414986 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:14.414954    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:14.417789 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:14.417758    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:30:23.148841 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:23.148799    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 28 10:30:23.149322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:23.148824    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 28 10:30:23.149322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:23.148954    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:30:23.149322 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:23.149039    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:30:25.446621 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.446588    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="116dc1b0266c218c3fed884f94a145975239555675621a1ef64d8efa1788fb51" exitCode=137
May 28 10:30:25.446621 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.446614    2556 generic.go:358] "Generic (PLEG): container finished" podID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerID="038ec36c3254c72122739850336d41086597caf89b3f4aa474687904afece5e3" exitCode=137
May 28 10:30:25.447016 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.446668    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"116dc1b0266c218c3fed884f94a145975239555675621a1ef64d8efa1788fb51"}
May 28 10:30:25.447016 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.446709    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"038ec36c3254c72122739850336d41086597caf89b3f4aa474687904afece5e3"}
May 28 10:30:25.529053 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.529032    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:30:25.679298 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679225    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679298 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679271    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679298 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679297    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fhc5\" (UniqueName: \"kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679557 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679346    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679557 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679382    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679557 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679449    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") pod \"832a91ad-7c24-477a-b1ed-bb23a38c956e\" (UID: \"832a91ad-7c24-477a-b1ed-bb23a38c956e\") "
May 28 10:30:25.679918 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.679884    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data" (OuterVolumeSpecName: "feast-data") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:30:25.681517 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.681492    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:30:25.681625 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.681514    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:30:25.681625 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.681561    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5" (OuterVolumeSpecName: "kube-api-access-7fhc5") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "kube-api-access-7fhc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:30:25.681742 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.681722    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls" (OuterVolumeSpecName: "online-tls") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:30:25.681789 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.681737    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "832a91ad-7c24-477a-b1ed-bb23a38c956e" (UID: "832a91ad-7c24-477a-b1ed-bb23a38c956e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:30:25.781083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781060    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:25.781083 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781084    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:25.781240 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781099    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fhc5\" (UniqueName: \"kubernetes.io/projected/832a91ad-7c24-477a-b1ed-bb23a38c956e-kube-api-access-7fhc5\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:25.781240 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781113    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/832a91ad-7c24-477a-b1ed-bb23a38c956e-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:25.781240 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781126    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:25.781240 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:25.781137    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/832a91ad-7c24-477a-b1ed-bb23a38c956e-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:30:26.452307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.452279    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"
May 28 10:30:26.452307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.452284    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq" event={"ID":"832a91ad-7c24-477a-b1ed-bb23a38c956e","Type":"ContainerDied","Data":"45c604d8313d302ffdcf5d41bff34f3ed7eb6796ae1c3a59c41c8323accac916"}
May 28 10:30:26.452783 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.452327    2556 scope.go:117] "RemoveContainer" containerID="d61cf7a66564ea865dc94352d40eca82876a9e619469dcb465a8465a15908966"
May 28 10:30:26.460878 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.460860    2556 scope.go:117] "RemoveContainer" containerID="116dc1b0266c218c3fed884f94a145975239555675621a1ef64d8efa1788fb51"
May 28 10:30:26.467690 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.467674    2556 scope.go:117] "RemoveContainer" containerID="1f226ea611b06c02799936b40dbe3bce9d6536c3868e1357c6506026bf4c939d"
May 28 10:30:26.472533 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.472497    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:30:26.475222 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.475204    2556 scope.go:117] "RemoveContainer" containerID="038ec36c3254c72122739850336d41086597caf89b3f4aa474687904afece5e3"
May 28 10:30:26.476346 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.476326    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-mmsqq"]
May 28 10:30:26.481793 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.481777    2556 scope.go:117] "RemoveContainer" containerID="23238932fd16a460878c5f769f7e020a0cdd04acf5c0b19478ced8cdc81322b2"
May 28 10:30:26.488541 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:26.488526    2556 scope.go:117] "RemoveContainer" containerID="146e32e3be108eba583a3a00f451a315ebee2cba02a72cf4b39690eff87e4354"
May 28 10:30:27.700992 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:30:27.700960    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" path="/var/lib/kubelet/pods/832a91ad-7c24-477a-b1ed-bb23a38c956e/volumes"
May 28 10:31:16.677184 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677148    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677653    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="feast-init"
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677668    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="feast-init"
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677688    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline"
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677697    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline"
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677721    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry"
May 28 10:31:16.677749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677729    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677766    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677775    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677801    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="feast-apply"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677809    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="feast-apply"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677819    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677826    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677930    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="registry"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677947    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="online"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677957    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="ui"
May 28 10:31:16.678079 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.677970    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="832a91ad-7c24-477a-b1ed-bb23a38c956e" containerName="offline"
May 28 10:31:16.681776 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.681745    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.688289 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.688091    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 10:31:16.688289 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.688091    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 10:31:16.689038 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.689001    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 10:31:16.689194 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.689043    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 10:31:16.689194 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.689180    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 10:31:16.689314 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.689297    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 10:31:16.689413 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.689375    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-fc8k5\""
May 28 10:31:16.724051 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.724017    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:31:16.809723 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtqfh\" (UniqueName: \"kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.809906 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809732    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.809906 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.809987 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.809987 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.810082 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.809989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911064    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtqfh\" (UniqueName: \"kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911111    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911133    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911166    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911200    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911307 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911237    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911572 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:31:16.911350    2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 10:31:16.911572 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:31:16.911439    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls podName:9d2f5854-84f2-4ecf-9fda-a166ec39606f nodeName:}" failed. No retries permitted until 2026-05-28 10:31:17.411416002 +0000 UTC m=+1560.304984253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-hqbx5" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 10:31:16.911732 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911709    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.911976 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.911936    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.913706 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.913676    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.913797 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.913735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:16.925173 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:16.925149    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtqfh\" (UniqueName: \"kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:17.415085 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:17.415048    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:17.417492 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:17.417467    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-hqbx5\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:17.596022 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:17.595985    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-fc8k5\""
May 28 10:31:17.603996 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:17.603976    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:17.748600 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:17.748564    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:31:17.749801 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:31:17.749780    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d2f5854_84f2_4ecf_9fda_a166ec39606f.slice/crio-27c5a0fd39218a4df2f782a69cd2806081c35b117fb53aee57aef06167e88a93 WatchSource:0}: Error finding container 27c5a0fd39218a4df2f782a69cd2806081c35b117fb53aee57aef06167e88a93: Status 404 returned error can't find the container with id 27c5a0fd39218a4df2f782a69cd2806081c35b117fb53aee57aef06167e88a93
May 28 10:31:18.606431 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:18.606391    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"d9825c3127b3df99a27d7a30544a91103ac4921c999f646616bfa53f120da707"}
May 28 10:31:18.606610 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:18.606439    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"27c5a0fd39218a4df2f782a69cd2806081c35b117fb53aee57aef06167e88a93"}
May 28 10:31:22.619116 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:22.619023    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerID="d9825c3127b3df99a27d7a30544a91103ac4921c999f646616bfa53f120da707" exitCode=0
May 28 10:31:22.619116 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:22.619101    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"d9825c3127b3df99a27d7a30544a91103ac4921c999f646616bfa53f120da707"}
May 28 10:31:23.624176 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:23.624145    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"3124e33bad63fae097311196d6a879bf73aa32918cfcac31a22add37063194ce"}
May 28 10:31:28.650611 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:28.650573    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerID="3124e33bad63fae097311196d6a879bf73aa32918cfcac31a22add37063194ce" exitCode=0
May 28 10:31:28.650988 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:28.650653    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"3124e33bad63fae097311196d6a879bf73aa32918cfcac31a22add37063194ce"}
May 28 10:31:29.660972 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:29.660935    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"b08ea702895e9ad54b60e272272af4bcf58809e6447e9d0e237fb2b6ccf8de0f"}
May 28 10:31:29.661467 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:29.660984    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"e0ecdff7dab6e8c2f3fe24e551957eac58bbdd0596ce08fcec43240635d064f9"}
May 28 10:31:29.661467 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:29.660997    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerStarted","Data":"83c629d9efba74d06f2fc294ef2d3c9ad14f86003e1b16e280d04eb1712e2e00"}
May 28 10:31:32.604419 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.604358    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:32.604419 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.604408    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:32.604419 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.604422    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:32.606130 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.606099    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
May 28 10:31:32.606130 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.606119    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 28 10:31:32.606304 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:32.606142    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 28 10:31:35.605066 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.605025    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.605463 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.605259    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.605626 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.605601    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.605767 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.605634    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.605831 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.605804    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.606071 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.606049    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.609249 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.609234    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.628970 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.628852    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podStartSLOduration=19.62883917 podStartE2EDuration="19.62883917s" podCreationTimestamp="2026-05-28 10:31:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:31:29.726192708 +0000 UTC m=+1572.619760978" watchObservedRunningTime="2026-05-28 10:31:35.62883917 +0000 UTC m=+1578.522407442"
May 28 10:31:35.680364 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.680340    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:31:35.683103 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:31:35.683083    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:32:37.852644 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.852607    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:32:37.853172 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.852996    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online" containerID="cri-o://83c629d9efba74d06f2fc294ef2d3c9ad14f86003e1b16e280d04eb1712e2e00" gracePeriod=30
May 28 10:32:37.853172 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.853061    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui" containerID="cri-o://b08ea702895e9ad54b60e272272af4bcf58809e6447e9d0e237fb2b6ccf8de0f" gracePeriod=30
May 28 10:32:37.853172 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.853075    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="offline" containerID="cri-o://e0ecdff7dab6e8c2f3fe24e551957eac58bbdd0596ce08fcec43240635d064f9" gracePeriod=30
May 28 10:32:37.943865 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.943826    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:32:37.944258 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.944204    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry" containerID="cri-o://8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde" gracePeriod=30
May 28 10:32:37.944258 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.944248    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" containerID="cri-o://5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910" gracePeriod=30
May 28 10:32:37.944471 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.944258    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline" containerID="cri-o://8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27" gracePeriod=30
May 28 10:32:37.944471 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:37.944233    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" containerID="cri-o://9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2" gracePeriod=30
May 28 10:32:38.863078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.863001    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2" exitCode=0
May 28 10:32:38.863078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.863037    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910" exitCode=0
May 28 10:32:38.863482 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.863073    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"}
May 28 10:32:38.863482 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.863108    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"}
May 28 10:32:38.865340 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.865321    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerID="b08ea702895e9ad54b60e272272af4bcf58809e6447e9d0e237fb2b6ccf8de0f" exitCode=0
May 28 10:32:38.865340 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.865338    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerID="83c629d9efba74d06f2fc294ef2d3c9ad14f86003e1b16e280d04eb1712e2e00" exitCode=0
May 28 10:32:38.865458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.865394    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"b08ea702895e9ad54b60e272272af4bcf58809e6447e9d0e237fb2b6ccf8de0f"}
May 28 10:32:38.865458 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:38.865420    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"83c629d9efba74d06f2fc294ef2d3c9ad14f86003e1b16e280d04eb1712e2e00"}
May 28 10:32:43.621830 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:43.621783    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
May 28 10:32:44.416041 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:44.415981    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
May 28 10:32:45.606024 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:45.605957    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 28 10:32:45.681171 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:45.681134    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 28 10:32:53.621627 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:53.621580    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
May 28 10:32:54.415074 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:54.415035    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
May 28 10:32:55.606371 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:55.606330    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 28 10:32:55.681193 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:32:55.681160    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 28 10:33:03.621658 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:03.621603    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
May 28 10:33:03.622122 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:03.621792    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:33:04.415127 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:04.415088    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
May 28 10:33:04.415320 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:04.415217    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:33:05.606502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:05.606464    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 28 10:33:05.606910 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:05.606630    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:33:05.681311 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:05.681277    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 28 10:33:05.681456 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:05.681373    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:33:07.951601 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:07.951572    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerID="e0ecdff7dab6e8c2f3fe24e551957eac58bbdd0596ce08fcec43240635d064f9" exitCode=137
May 28 10:33:07.951993 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:07.951628    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"e0ecdff7dab6e8c2f3fe24e551957eac58bbdd0596ce08fcec43240635d064f9"}
May 28 10:33:08.498380 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.498360    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:33:08.593369 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593334    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtqfh\" (UniqueName: \"kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.593518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593408    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.593518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593452    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.593518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593487    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.593518 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593515    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.593749 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593709    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data\") pod \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\" (UID: \"9d2f5854-84f2-4ecf-9fda-a166ec39606f\") "
May 28 10:33:08.594242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.593932    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:33:08.594242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.594216    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/9d2f5854-84f2-4ecf-9fda-a166ec39606f-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.594546 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.594270    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data" (OuterVolumeSpecName: "feast-data") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:33:08.595776 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.595755    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.595907 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.595888    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.595961 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.595905    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh" (OuterVolumeSpecName: "kube-api-access-qtqfh") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "kube-api-access-qtqfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:33:08.596210 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.596196    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls" (OuterVolumeSpecName: "online-tls") pod "9d2f5854-84f2-4ecf-9fda-a166ec39606f" (UID: "9d2f5854-84f2-4ecf-9fda-a166ec39606f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.608351 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.608334    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:33:08.694532 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694464    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.694532 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694505    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwq62\" (UniqueName: \"kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.694729 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694558    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.694729 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694716    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.694833 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694761    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.694833 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.694803    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data\") pod \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\" (UID: \"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd\") "
May 28 10:33:08.695077 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695056    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9d2f5854-84f2-4ecf-9fda-a166ec39606f-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.695164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695083    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtqfh\" (UniqueName: \"kubernetes.io/projected/9d2f5854-84f2-4ecf-9fda-a166ec39606f-kube-api-access-qtqfh\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.695164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695094    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.695164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695104    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.695164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695121    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9d2f5854-84f2-4ecf-9fda-a166ec39606f-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.695561 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.695530    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data" (OuterVolumeSpecName: "feast-data") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:33:08.696710 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.696683    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.696813 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.696718    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62" (OuterVolumeSpecName: "kube-api-access-lwq62") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "kube-api-access-lwq62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:33:08.696872 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.696810    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.697067 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.697050    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls" (OuterVolumeSpecName: "online-tls") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.697118 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.697088    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" (UID: "8f0e8bd6-bf66-4a12-afd3-a78db2f919dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:33:08.795620 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795584    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-registry-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.795620 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795622    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwq62\" (UniqueName: \"kubernetes.io/projected/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-kube-api-access-lwq62\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.795871 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795637    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-online-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.795871 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795652    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-ui-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.795871 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795665    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-offline-tls\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.795871 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.795677    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd-feast-data\") on node \"ip-10-0-133-103.ec2.internal\" DevicePath \"\""
May 28 10:33:08.956645 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956571    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27" exitCode=137
May 28 10:33:08.956645 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956603    2556 generic.go:358] "Generic (PLEG): container finished" podID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerID="8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde" exitCode=137
May 28 10:33:08.957052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956661    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"}
May 28 10:33:08.957052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956692    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"}
May 28 10:33:08.957052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956704    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn" event={"ID":"8f0e8bd6-bf66-4a12-afd3-a78db2f919dd","Type":"ContainerDied","Data":"57c767ea483ef488292881a8e5b48c43f87cb3531da94a4b04e0af60ac08f685"}
May 28 10:33:08.957052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956718    2556 scope.go:117] "RemoveContainer" containerID="9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"
May 28 10:33:08.957052 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.956667    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"
May 28 10:33:08.959252 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.959228    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5" event={"ID":"9d2f5854-84f2-4ecf-9fda-a166ec39606f","Type":"ContainerDied","Data":"27c5a0fd39218a4df2f782a69cd2806081c35b117fb53aee57aef06167e88a93"}
May 28 10:33:08.959345 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.959289    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"
May 28 10:33:08.965782 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.965760    2556 scope.go:117] "RemoveContainer" containerID="8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"
May 28 10:33:08.973139 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.973123    2556 scope.go:117] "RemoveContainer" containerID="5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"
May 28 10:33:08.979784 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.979765    2556 scope.go:117] "RemoveContainer" containerID="8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"
May 28 10:33:08.984027 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.983992    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:33:08.987502 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.987477    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7sbn"]
May 28 10:33:08.987915 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.987902    2556 scope.go:117] "RemoveContainer" containerID="a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"
May 28 10:33:08.994540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:08.994526    2556 scope.go:117] "RemoveContainer" containerID="86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"
May 28 10:33:09.000207 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.000189    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:33:09.001757 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.001705    2556 scope.go:117] "RemoveContainer" containerID="9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"
May 28 10:33:09.002283 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.002256    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2\": container with ID starting with 9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2 not found: ID does not exist" containerID="9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"
May 28 10:33:09.002395 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002296    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"} err="failed to get container status \"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2\": rpc error: code = NotFound desc = could not find container \"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2\": container with ID starting with 9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2 not found: ID does not exist"
May 28 10:33:09.002395 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002322    2556 scope.go:117] "RemoveContainer" containerID="8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"
May 28 10:33:09.002632 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.002615    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27\": container with ID starting with 8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27 not found: ID does not exist" containerID="8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"
May 28 10:33:09.002681 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002639    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"} err="failed to get container status \"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27\": rpc error: code = NotFound desc = could not find container \"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27\": container with ID starting with 8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27 not found: ID does not exist"
May 28 10:33:09.002681 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002657    2556 scope.go:117] "RemoveContainer" containerID="5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"
May 28 10:33:09.002897 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.002878    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910\": container with ID starting with 5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910 not found: ID does not exist" containerID="5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"
May 28 10:33:09.002940 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002904    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"} err="failed to get container status \"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910\": rpc error: code = NotFound desc = could not find container \"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910\": container with ID starting with 5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910 not found: ID does not exist"
May 28 10:33:09.002940 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.002921    2556 scope.go:117] "RemoveContainer" containerID="8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"
May 28 10:33:09.003182 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.003167    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde\": container with ID starting with 8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde not found: ID does not exist" containerID="8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"
May 28 10:33:09.003242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003185    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"} err="failed to get container status \"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde\": rpc error: code = NotFound desc = could not find container \"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde\": container with ID starting with 8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde not found: ID does not exist"
May 28 10:33:09.003242 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003199    2556 scope.go:117] "RemoveContainer" containerID="a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"
May 28 10:33:09.003433 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.003414    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a\": container with ID starting with a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a not found: ID does not exist" containerID="a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"
May 28 10:33:09.003494 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003441    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"} err="failed to get container status \"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a\": rpc error: code = NotFound desc = could not find container \"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a\": container with ID starting with a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a not found: ID does not exist"
May 28 10:33:09.003494 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003456    2556 scope.go:117] "RemoveContainer" containerID="86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"
May 28 10:33:09.003695 ip-10-0-133-103 kubenswrapper[2556]: E0528 10:33:09.003675    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a\": container with ID starting with 86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a not found: ID does not exist" containerID="86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"
May 28 10:33:09.003760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003705    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"} err="failed to get container status \"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a\": rpc error: code = NotFound desc = could not find container \"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a\": container with ID starting with 86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a not found: ID does not exist"
May 28 10:33:09.003760 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003728    2556 scope.go:117] "RemoveContainer" containerID="9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"
May 28 10:33:09.003957 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003940    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2"} err="failed to get container status \"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2\": rpc error: code = NotFound desc = could not find container \"9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2\": container with ID starting with 9a037a888c3cc0d8af44d992c1a26feffef3d908b8aa4469afcef8f7458d21c2 not found: ID does not exist"
May 28 10:33:09.004044 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.003970    2556 scope.go:117] "RemoveContainer" containerID="8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"
May 28 10:33:09.004254 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004227    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27"} err="failed to get container status \"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27\": rpc error: code = NotFound desc = could not find container \"8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27\": container with ID starting with 8b01875e79384d6e84927e8b2f9f1fc1bc960516c8dc15b954e08e4a88402d27 not found: ID does not exist"
May 28 10:33:09.004254 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004245    2556 scope.go:117] "RemoveContainer" containerID="5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"
May 28 10:33:09.004446 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004430    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910"} err="failed to get container status \"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910\": rpc error: code = NotFound desc = could not find container \"5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910\": container with ID starting with 5d61b68ae5dd0e7dcb281ebe5b26261b82d099ddab4c5cc1c561756edf8f6910 not found: ID does not exist"
May 28 10:33:09.004491 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004447    2556 scope.go:117] "RemoveContainer" containerID="8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"
May 28 10:33:09.004491 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004452    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-hqbx5"]
May 28 10:33:09.004656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004641    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde"} err="failed to get container status \"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde\": rpc error: code = NotFound desc = could not find container \"8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde\": container with ID starting with 8a36ab8429a53f79a61109479acee0d33fad079944b27785c53d037ceabfefde not found: ID does not exist"
May 28 10:33:09.004707 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004656    2556 scope.go:117] "RemoveContainer" containerID="a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"
May 28 10:33:09.004850 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004835    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a"} err="failed to get container status \"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a\": rpc error: code = NotFound desc = could not find container \"a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a\": container with ID starting with a8dc870f1cc73311baab920a0b16d93eededb960ba102f0e9f2d90780d143f6a not found: ID does not exist"
May 28 10:33:09.004896 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.004850    2556 scope.go:117] "RemoveContainer" containerID="86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"
May 28 10:33:09.005087 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.005070    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a"} err="failed to get container status \"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a\": rpc error: code = NotFound desc = could not find container \"86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a\": container with ID starting with 86b96c678004fa8ecf7eb6ea2c6d65a2c469ed57df5408f8021a44931027287a not found: ID does not exist"
May 28 10:33:09.005137 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.005087    2556 scope.go:117] "RemoveContainer" containerID="b08ea702895e9ad54b60e272272af4bcf58809e6447e9d0e237fb2b6ccf8de0f"
May 28 10:33:09.011826 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.011809    2556 scope.go:117] "RemoveContainer" containerID="e0ecdff7dab6e8c2f3fe24e551957eac58bbdd0596ce08fcec43240635d064f9"
May 28 10:33:09.019297 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.019266    2556 scope.go:117] "RemoveContainer" containerID="83c629d9efba74d06f2fc294ef2d3c9ad14f86003e1b16e280d04eb1712e2e00"
May 28 10:33:09.026566 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.026547    2556 scope.go:117] "RemoveContainer" containerID="3124e33bad63fae097311196d6a879bf73aa32918cfcac31a22add37063194ce"
May 28 10:33:09.032990 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.032974    2556 scope.go:117] "RemoveContainer" containerID="d9825c3127b3df99a27d7a30544a91103ac4921c999f646616bfa53f120da707"
May 28 10:33:09.701556 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.701523    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" path="/var/lib/kubelet/pods/8f0e8bd6-bf66-4a12-afd3-a78db2f919dd/volumes"
May 28 10:33:09.702157 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:09.702143    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" path="/var/lib/kubelet/pods/9d2f5854-84f2-4ecf-9fda-a166ec39606f/volumes"
May 28 10:33:45.111102 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111023    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sg2z8/must-gather-kkhzq"]
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111360    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111371    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111382    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111388    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111395    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="offline"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111401    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="offline"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111409    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="feast-init"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111414    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="feast-init"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111442    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="feast-apply"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111448    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="feast-apply"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111455    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="feast-apply"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111460    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="feast-apply"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111466    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111471    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111485    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111490    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111497    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111504    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111515    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="feast-init"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111521    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="feast-init"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111526    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry"
May 28 10:33:45.111529 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111531    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111576    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="online"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111588    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="ui"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111597    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="ui"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111605    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="online"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111610    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="offline"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111617    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d2f5854-84f2-4ecf-9fda-a166ec39606f" containerName="offline"
May 28 10:33:45.112178 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.111623    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f0e8bd6-bf66-4a12-afd3-a78db2f919dd" containerName="registry"
May 28 10:33:45.116078 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.116060    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.118731 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.118709    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sg2z8\"/\"default-dockercfg-vq5rc\""
May 28 10:33:45.118823 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.118718    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"openshift-service-ca.crt\""
May 28 10:33:45.119585 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.119566    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"kube-root-ca.crt\""
May 28 10:33:45.122684 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.122653    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/must-gather-kkhzq"]
May 28 10:33:45.174262 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.174228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-must-gather-output\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.174401 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.174270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jw9x\" (UniqueName: \"kubernetes.io/projected/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-kube-api-access-4jw9x\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.275606 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.275573    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-must-gather-output\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.275606 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.275610    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jw9x\" (UniqueName: \"kubernetes.io/projected/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-kube-api-access-4jw9x\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.275951 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.275932    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-must-gather-output\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.284164 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.284143    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jw9x\" (UniqueName: \"kubernetes.io/projected/c7984baa-5b27-41f5-8f7d-d1dfc0575d77-kube-api-access-4jw9x\") pod \"must-gather-kkhzq\" (UID: \"c7984baa-5b27-41f5-8f7d-d1dfc0575d77\") " pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.434019 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.433926    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/must-gather-kkhzq"
May 28 10:33:45.558240 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.558216    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/must-gather-kkhzq"]
May 28 10:33:45.560505 ip-10-0-133-103 kubenswrapper[2556]: W0528 10:33:45.560473    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7984baa_5b27_41f5_8f7d_d1dfc0575d77.slice/crio-d9954cbc07a83c2de47bb334f18f3bab3e40c9afc34aa844e16a8d87d4f5b448 WatchSource:0}: Error finding container d9954cbc07a83c2de47bb334f18f3bab3e40c9afc34aa844e16a8d87d4f5b448: Status 404 returned error can't find the container with id d9954cbc07a83c2de47bb334f18f3bab3e40c9afc34aa844e16a8d87d4f5b448
May 28 10:33:45.562567 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:45.562553    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:33:46.067717 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:46.067681    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/must-gather-kkhzq" event={"ID":"c7984baa-5b27-41f5-8f7d-d1dfc0575d77","Type":"ContainerStarted","Data":"d9954cbc07a83c2de47bb334f18f3bab3e40c9afc34aa844e16a8d87d4f5b448"}
May 28 10:33:47.073631 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:47.073591    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/must-gather-kkhzq" event={"ID":"c7984baa-5b27-41f5-8f7d-d1dfc0575d77","Type":"ContainerStarted","Data":"340addd922f7ee0d608202653321c4e2522d73f8bb2d90d1f66c4924a82bc16b"}
May 28 10:33:47.073631 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:47.073636    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/must-gather-kkhzq" event={"ID":"c7984baa-5b27-41f5-8f7d-d1dfc0575d77","Type":"ContainerStarted","Data":"b4c14490be2b925098fd1a60086bc05ec5cf310fcd8a463f9e4ce1244b902b2a"}
May 28 10:33:47.096619 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:47.096573    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sg2z8/must-gather-kkhzq" podStartSLOduration=1.150784316 podStartE2EDuration="2.096557232s" podCreationTimestamp="2026-05-28 10:33:45 +0000 UTC" firstStartedPulling="2026-05-28 10:33:45.562676116 +0000 UTC m=+1708.456244364" lastFinishedPulling="2026-05-28 10:33:46.508449021 +0000 UTC m=+1709.402017280" observedRunningTime="2026-05-28 10:33:47.095972508 +0000 UTC m=+1709.989540778" watchObservedRunningTime="2026-05-28 10:33:47.096557232 +0000 UTC m=+1709.990125502"
May 28 10:33:47.896748 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:47.896718    2556 ???:1] "http: TLS handshake error from 10.0.129.122:33788: EOF"
May 28 10:33:47.900847 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:47.900815    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f8d6x_1f6a2ed6-c938-4000-a381-32e5467f7083/global-pull-secret-syncer/0.log"
May 28 10:33:48.093815 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:48.093786    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hmlwc_5a56e86f-ebb8-42d1-89fe-28860f216bf1/konnectivity-agent/0.log"
May 28 10:33:48.205973 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:48.205893    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-103.ec2.internal_810ac29c36d8ca42a5ce8d8f9964b08e/haproxy/0.log"
May 28 10:33:50.964094 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:50.964061    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/alertmanager/0.log"
May 28 10:33:51.012982 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.012951    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/config-reloader/0.log"
May 28 10:33:51.062731 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.062688    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/kube-rbac-proxy-web/0.log"
May 28 10:33:51.102576 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.102548    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/kube-rbac-proxy/0.log"
May 28 10:33:51.154618 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.154590    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/kube-rbac-proxy-metric/0.log"
May 28 10:33:51.197442 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.197360    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/prom-label-proxy/0.log"
May 28 10:33:51.247896 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.247859    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba748922-fad7-4155-967c-60be1e05f900/init-config-reloader/0.log"
May 28 10:33:51.340763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.340725    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9dldx_c578fa14-8f54-425e-a3f6-6a1728496d40/kube-state-metrics/0.log"
May 28 10:33:51.386825 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.386797    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9dldx_c578fa14-8f54-425e-a3f6-6a1728496d40/kube-rbac-proxy-main/0.log"
May 28 10:33:51.429540 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.429499    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9dldx_c578fa14-8f54-425e-a3f6-6a1728496d40/kube-rbac-proxy-self/0.log"
May 28 10:33:51.488571 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.488534    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-684785568b-qqtbn_e746ae5f-533a-4330-8893-f959c9579fa7/metrics-server/0.log"
May 28 10:33:51.629196 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.629126    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8czws_62f74565-7d8d-4370-8de7-1103edb7e813/node-exporter/0.log"
May 28 10:33:51.685763 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.685736    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8czws_62f74565-7d8d-4370-8de7-1103edb7e813/kube-rbac-proxy/0.log"
May 28 10:33:51.740321 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:51.740296    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8czws_62f74565-7d8d-4370-8de7-1103edb7e813/init-textfile/0.log"
May 28 10:33:52.638911 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.638832    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-7qr45_0463b172-1a5b-4e36-a6cf-8e04218372e6/prometheus-operator-admission-webhook/0.log"
May 28 10:33:52.689365 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.689335    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd857747b-fwz5b_f9bf3734-3b0c-4267-bf5d-c33fef1a2306/telemeter-client/0.log"
May 28 10:33:52.729862 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.729837    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd857747b-fwz5b_f9bf3734-3b0c-4267-bf5d-c33fef1a2306/reload/0.log"
May 28 10:33:52.770265 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.770241    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bd857747b-fwz5b_f9bf3734-3b0c-4267-bf5d-c33fef1a2306/kube-rbac-proxy/0.log"
May 28 10:33:52.812051 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.812020    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/thanos-query/0.log"
May 28 10:33:52.855984 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.855950    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/kube-rbac-proxy-web/0.log"
May 28 10:33:52.896813 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.896739    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/kube-rbac-proxy/0.log"
May 28 10:33:52.944656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.944630    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/prom-label-proxy/0.log"
May 28 10:33:52.992194 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:52.992171    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/kube-rbac-proxy-rules/0.log"
May 28 10:33:53.051626 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.051600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d977f6458-n2bsj_ec535e79-625f-4899-82ec-1885e870e0e8/kube-rbac-proxy-metrics/0.log"
May 28 10:33:53.869623 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.868428    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"]
May 28 10:33:53.872782 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.872380    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:53.882985 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.882963    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"]
May 28 10:33:53.959580 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.959551    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-podres\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:53.959741 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.959608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-lib-modules\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:53.959741 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.959658    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-sys\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:53.959741 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.959708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2z5f\" (UniqueName: \"kubernetes.io/projected/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-kube-api-access-m2z5f\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:53.959860 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:53.959772    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-proc\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060188 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060155    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-lib-modules\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060216    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-sys\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060258    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2z5f\" (UniqueName: \"kubernetes.io/projected/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-kube-api-access-m2z5f\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060301    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-proc\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060325    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-podres\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060333    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-sys\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060378 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060324    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-lib-modules\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060601 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060418    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-proc\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.060601 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.060424    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-podres\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.074168 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.074144    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2z5f\" (UniqueName: \"kubernetes.io/projected/dfadcea4-44c2-4379-b1e0-2df7c9dfb229-kube-api-access-m2z5f\") pod \"perf-node-gather-daemonset-qnm48\" (UID: \"dfadcea4-44c2-4379-b1e0-2df7c9dfb229\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.184209 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.184130    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:54.329624 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.328897    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"]
May 28 10:33:54.742683 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.742652    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6bdc646b-r99p4_72bb7873-ee5d-42de-af1e-2628d0a5b27f/console/0.log"
May 28 10:33:54.776876 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:54.776844    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-5bfkb_2c87ea24-5c59-4e28-9dc5-a81ec7f670db/download-server/0.log"
May 28 10:33:55.105786 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.105714    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48" event={"ID":"dfadcea4-44c2-4379-b1e0-2df7c9dfb229","Type":"ContainerStarted","Data":"40d2620009791f8a19bb7565acc9cd312bfc20fcce0e2d55f414961c2554f138"}
May 28 10:33:55.105786 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.105747    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48" event={"ID":"dfadcea4-44c2-4379-b1e0-2df7c9dfb229","Type":"ContainerStarted","Data":"5832501f2d31e3676cdef10792495c7f1b3e94be66f84908ee13a7e9f8e7348f"}
May 28 10:33:55.106288 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.105867    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:33:55.122385 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.122274    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48" podStartSLOduration=2.122258389 podStartE2EDuration="2.122258389s" podCreationTimestamp="2026-05-28 10:33:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:33:55.121345277 +0000 UTC m=+1718.014913547" watchObservedRunningTime="2026-05-28 10:33:55.122258389 +0000 UTC m=+1718.015826661"
May 28 10:33:55.878799 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.878770    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgmvg_c0bb2541-827b-4d44-8783-2bc1b4530098/dns/0.log"
May 28 10:33:55.900787 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.900761    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgmvg_c0bb2541-827b-4d44-8783-2bc1b4530098/kube-rbac-proxy/0.log"
May 28 10:33:55.998597 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:55.998572    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f46zp_6b2ce129-fabb-4741-9581-91c7796d802f/dns-node-resolver/0.log"
May 28 10:33:56.440595 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:56.440564    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-559b4dc97d-4tkvj_02c44456-a0dc-4b39-98d8-fa737c0e47b8/registry/0.log"
May 28 10:33:56.501656 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:56.501633    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c7hrj_a84a19c4-fc9a-43b1-b80b-de995de2bfc9/node-ca/0.log"
May 28 10:33:57.643630 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:57.643604    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln6r8_0b114e3b-8acb-4eb3-be78-abb4f7a4ecaa/serve-healthcheck-canary/0.log"
May 28 10:33:58.113101 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:58.113062    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxbg5_9a84a60e-edfe-4767-849f-54810807652e/kube-rbac-proxy/0.log"
May 28 10:33:58.161053 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:58.161029    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxbg5_9a84a60e-edfe-4767-849f-54810807652e/exporter/0.log"
May 28 10:33:58.203648 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:33:58.203627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxbg5_9a84a60e-edfe-4767-849f-54810807652e/extractor/0.log"
May 28 10:34:01.122421 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:01.122398    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-qnm48"
May 28 10:34:02.861319 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:02.861234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-c9cht_bc948a44-2d68-4230-9096-b0bf956d8072/migrator/0.log"
May 28 10:34:02.886606 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:02.886565    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-c9cht_bc948a44-2d68-4230-9096-b0bf956d8072/graceful-termination/0.log"
May 28 10:34:04.386028 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.385985    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/kube-multus-additional-cni-plugins/0.log"
May 28 10:34:04.411161 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.411131    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/egress-router-binary-copy/0.log"
May 28 10:34:04.443264 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.443241    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/cni-plugins/0.log"
May 28 10:34:04.473147 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.473115    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/bond-cni-plugin/0.log"
May 28 10:34:04.498209 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.498178    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/routeoverride-cni/0.log"
May 28 10:34:04.520827 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.520797    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/whereabouts-cni-bincopy/0.log"
May 28 10:34:04.544879 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.544859    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dmpj4_76df4a2b-f318-46f4-9977-4ec3d2fd4cf5/whereabouts-cni/0.log"
May 28 10:34:04.830404 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:04.830375    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k8wgv_2c18d3f1-4b9b-4b6c-b090-e3bf3aa1cc73/kube-multus/0.log"
May 28 10:34:05.046730 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:05.046703    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhdk7_a0f466b4-f772-4529-abcb-12e086451531/network-metrics-daemon/0.log"
May 28 10:34:05.068495 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:05.068478    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhdk7_a0f466b4-f772-4529-abcb-12e086451531/kube-rbac-proxy/0.log"
May 28 10:34:06.494877 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.494841    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/ovn-controller/0.log"
May 28 10:34:06.528352 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.528321    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/ovn-acl-logging/0.log"
May 28 10:34:06.547273 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.547246    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/kube-rbac-proxy-node/0.log"
May 28 10:34:06.573613 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.573590    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/kube-rbac-proxy-ovn-metrics/0.log"
May 28 10:34:06.602784 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.602762    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/northd/0.log"
May 28 10:34:06.632410 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.632383    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/nbdb/0.log"
May 28 10:34:06.657599 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.657580    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/sbdb/0.log"
May 28 10:34:06.768954 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:06.768890    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmh9c_e32fb6e9-90d6-48ec-8859-bbea1670da36/ovnkube-controller/0.log"
May 28 10:34:07.772336 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:07.772311    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gqlck_f5465d80-abd4-439f-9ad4-9f8d32139de6/network-check-target-container/0.log"
May 28 10:34:08.744677 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:08.744649    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8fb22_52bb2718-46bb-495e-a103-52fa11211d97/iptables-alerter/0.log"
May 28 10:34:09.426795 ip-10-0-133-103 kubenswrapper[2556]: I0528 10:34:09.426768    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4zfwm_1dd7b734-bcae-41f2-82cb-3f86e58e8e72/tuned/0.log"