May 26 00:05:10.788996 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 00:05:10.789008 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 00:05:10.789018 ip-10-0-131-165 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 00:05:10.789266 ip-10-0-131-165 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 00:05:20.875471 ip-10-0-131-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 00:05:20.875489 ip-10-0-131-165 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1d9bdbcb5a75418d9b56208f771a77ee --
May 26 00:07:41.127901 ip-10-0-131-165 systemd[1]: Starting Kubernetes Kubelet...
May 26 00:07:41.633241 ip-10-0-131-165 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:41.633241 ip-10-0-131-165 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 00:07:41.633241 ip-10-0-131-165 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:41.633241 ip-10-0-131-165 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 00:07:41.633767 ip-10-0-131-165 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:41.635035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.634906    2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 00:07:41.640405 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640389    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:41.640405 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640404    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640407    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640411    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640414    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640417    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640420    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640423    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640426    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640429    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640432    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640435    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640438    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640440    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640450    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640453    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640456    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640459    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640462    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640465    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:41.640466 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640469    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640472    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640475    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640478    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640481    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640483    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640486    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640489    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640491    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640494    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640497    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640500    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640503    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640506    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640508    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640511    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640513    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640516    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640518    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640520    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:41.641018 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640523    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640525    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640528    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640530    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640533    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640535    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640538    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640543    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640546    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640550    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640553    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640556    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640559    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640561    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640565    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640568    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640571    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640573    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640576    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:41.641770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640578    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640581    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640584    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640586    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640589    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640592    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640594    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640609    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640611    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640614    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640617    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640620    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640622    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640625    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640627    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640630    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640633    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640635    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640639    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640643    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:41.642271 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640646    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640649    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640652    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640655    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640657    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640660    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.640663    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.641791    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.641820    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.641984    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642001    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642005    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642013    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642018    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642021    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642025    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642028    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642031    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642034    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642037    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:41.642774 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642040    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642043    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642045    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642048    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642051    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642053    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642056    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642059    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642062    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642064    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642067    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642069    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642072    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642075    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642077    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642080    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642083    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642085    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642088    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:41.643261 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642091    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642093    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642096    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642105    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642108    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642111    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642114    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642116    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642119    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642122    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642125    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642128    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642130    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642133    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642136    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642140    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642144    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642147    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642150    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:41.643830 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642153    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642155    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642158    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642161    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642164    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642166    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642169    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642171    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642174    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642177    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642180    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642183    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642185    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642188    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642190    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642193    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642196    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642199    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642201    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642204    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:41.644297 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642206    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642209    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642211    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642214    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642216    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642219    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642221    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642224    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642226    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642229    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642233    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642236    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642238    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642241    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642243    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642315    2560 flags.go:64] FLAG: --address="0.0.0.0"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642322    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642332    2560 flags.go:64] FLAG: --anonymous-auth="true"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642338    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642345    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642348    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 00:07:41.644797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642353    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642358    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642362    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642365    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642368    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642371    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642374    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642379    2560 flags.go:64] FLAG: --cgroup-root=""
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642382    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642385    2560 flags.go:64] FLAG: --client-ca-file=""
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642388    2560 flags.go:64] FLAG: --cloud-config=""
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642391    2560 flags.go:64] FLAG: --cloud-provider="external"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642394    2560 flags.go:64] FLAG: --cluster-dns="[]"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642399    2560 flags.go:64] FLAG: --cluster-domain=""
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642401    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642405    2560 flags.go:64] FLAG: --config-dir=""
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642408    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642411    2560 flags.go:64] FLAG: --container-log-max-files="5"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642415    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642418    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642421    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642424    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642427    2560 flags.go:64] FLAG: --contention-profiling="false"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642430    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 00:07:41.645314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642433    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642437    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642440    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642444    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642447    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642450    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642453    2560 flags.go:64] FLAG: --enable-load-reader="false"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642456    2560 flags.go:64] FLAG: --enable-server="true"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642459    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642465    2560 flags.go:64] FLAG: --event-burst="100"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642468    2560 flags.go:64] FLAG: --event-qps="50"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642471    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642474    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642477    2560 flags.go:64] FLAG: --eviction-hard=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642481    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642486    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642489    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642492    2560 flags.go:64] FLAG: --eviction-soft=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642495    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642498    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642501    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642504    2560 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642507    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642510    2560 flags.go:64] FLAG: --fail-swap-on="true"
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642513    2560 flags.go:64] FLAG: --feature-gates=""
May 26 00:07:41.645908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642517    2560 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642520    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642523    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642526    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642530    2560 flags.go:64] FLAG: --healthz-port="10248"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642533    2560 flags.go:64] FLAG: --help="false"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642535    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-131-165.ec2.internal"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642539    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642542    2560 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642544    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642548    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642551    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642554    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642557    2560 flags.go:64] FLAG: --image-service-endpoint=""
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642560    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642562    2560 flags.go:64] FLAG: --kube-api-burst="100"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642565    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642568    2560 flags.go:64] FLAG: --kube-api-qps="50"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642571    2560 flags.go:64] FLAG: --kube-reserved=""
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642574    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642577    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642580    2560 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642583    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642586    2560 flags.go:64] FLAG: --lock-file=""
May 26 00:07:41.646538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642589    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642592    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642610    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642615    2560 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642618    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642621    2560 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642625    2560 flags.go:64] FLAG: --logging-format="text"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642628    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642631    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642634    2560 flags.go:64] FLAG: --manifest-url=""
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642637    2560 flags.go:64] FLAG: --manifest-url-header=""
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642642    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642645    2560 flags.go:64] FLAG: --max-open-files="1000000"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642650    2560 flags.go:64] FLAG: --max-pods="110"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642653    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642656    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642658    2560 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642661    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642664    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642667    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642670    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642678    2560 flags.go:64] FLAG: --node-status-max-images="50"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642681    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642684    2560 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 00:07:41.647143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642687    2560 flags.go:64] FLAG: --pod-cidr=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642690    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642696    2560 flags.go:64] FLAG: --pod-manifest-path=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642699    2560 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642702    2560 flags.go:64] FLAG: --pods-per-core="0"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642706    2560 flags.go:64] FLAG: --port="10250"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642709    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642712    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00adc94e0c65ec850"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642715    2560 flags.go:64] FLAG: --qos-reserved=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642718    2560 flags.go:64] FLAG: --read-only-port="10255"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642721    2560 flags.go:64] FLAG: --register-node="true"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642724    2560 flags.go:64] FLAG: --register-schedulable="true"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642727    2560 flags.go:64] FLAG: --register-with-taints=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642731    2560 flags.go:64] FLAG: --registry-burst="10"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642734    2560 flags.go:64] FLAG: --registry-qps="5"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642737    2560 flags.go:64] FLAG: --reserved-cpus=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642740    2560 flags.go:64] FLAG: --reserved-memory=""
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642744    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642747    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642749    2560 flags.go:64] FLAG: --rotate-certificates="false"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642752    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642755    2560 flags.go:64] FLAG: --runonce="false"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642758    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642761    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642764    2560 flags.go:64] FLAG: --seccomp-default="false"
May 26 00:07:41.647720 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642767    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642770    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642773    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642777    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642780    2560 flags.go:64] FLAG: --storage-driver-password="root"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642783    2560 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642786    2560 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642789    2560 flags.go:64] FLAG: --storage-driver-user="root"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642792    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642795    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642798    2560 flags.go:64] FLAG: --system-cgroups=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642801    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642807    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642810    2560 flags.go:64] FLAG: --tls-cert-file=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642813    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642817    2560 flags.go:64] FLAG: --tls-min-version=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642820    2560 flags.go:64] FLAG: --tls-private-key-file=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642823    2560 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642826    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642829    2560 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642832    2560 flags.go:64] FLAG: --v="2"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642836    2560 flags.go:64] FLAG: --version="false"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642840    2560 flags.go:64] FLAG: --vmodule=""
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642844    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.642847    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 00:07:41.648383 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642939    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642943    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642946    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642949    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642953    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642955    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642958    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642961    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642964    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642967    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642969    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642971    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642974    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642977    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642980    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642982    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642985    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642988    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642991    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642993    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:41.649029 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.642996    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643000    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643004    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643007    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643010    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643012    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643015    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643018    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643020    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643023    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643025    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643028    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643031    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643033    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643036    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643039    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643041    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643044    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643048    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643050    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:41.649551 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643053    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643055    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643058    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643060    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643063    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643065    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643068    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643070    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643073    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643079    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643082    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643085    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643088    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643090    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643093    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643096    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643098    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643103    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643105    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:41.650052 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643108    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643111    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643113    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643116    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643120    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643123    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643126    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643129    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643132    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643134    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643137    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643141    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643143    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643146    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643148    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643151    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643154    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643156    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643159    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:41.650508 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643161    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643164    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643166    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643170    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643173    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643176    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643179    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.643181    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.643187    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.650540    2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.650557    2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650617    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650623    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650626    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650630    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650635    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:41.650999 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650638    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650641    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650644    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650647    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650650    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650653    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650656    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650659    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650662    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650664    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650667    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650670    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650673    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650675    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650678    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650680    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650683    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650686    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650688    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650690    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:41.651422 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650693    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650696    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650698    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650701    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650703    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650706    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650711    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650714    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650717    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650719    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650722    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650724    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650727    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650730    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650732    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650735    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650738    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650740    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650743    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650746    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:41.651927 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650748    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650751    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650753    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650756    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650758    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650761    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650763    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650766    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650769    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650771    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650774    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650776    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650779    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650781    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650784    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650788    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650791    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650794    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650798    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650802    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:41.652434 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650805    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650808    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650811    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650814    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650816    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650819    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650821    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650824    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650826    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650829    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650831    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650834    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650836    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650839    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650842    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650845    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650847    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650850    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650852    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:41.652934 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650855    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650857    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.650862    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650958    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650962    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650965    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650968    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650971    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650973    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650976    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650979    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650982    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650985    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650988    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650991    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:41.653394 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650994    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.650998    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651001    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651005    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651007    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651010    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651013    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651016    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651018    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651021    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651023    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651026    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651028    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651031    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651034    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651036    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651039    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651041    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651044    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651046    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:41.653770 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651049    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651051    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651054    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651056    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651059    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651061    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651064    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651066    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651069    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651072    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651075    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651078    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651081    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651084    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651086    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651088    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651091    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651094    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651096    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651098    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:41.654246 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651101    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651103    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651106    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651108    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651111    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651114    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651118    2560 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651121    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651124    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651126    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651129    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651131    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651134    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651137    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651139    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651141    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651144    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651147    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651149    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651152    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:41.654735 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651155    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651157    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651160    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651163    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651166    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651169    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651172    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651174    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651177    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651180    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651182    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651185    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651188    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:41.651191    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.651196    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:41.655235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.652058    2560 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 00:07:41.656337 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.656322    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 00:07:41.657325 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.657313    2560 server.go:1019] "Starting client certificate rotation"
May 26 00:07:41.657429 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.657413    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 00:07:41.657464 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.657450    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 00:07:41.686765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.686744    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 00:07:41.690482 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.690462    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 00:07:41.712370 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.712350    2560 log.go:25] "Validated CRI v1 runtime API"
May 26 00:07:41.714430 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.714398    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 00:07:41.720071 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.720056    2560 log.go:25] "Validated CRI v1 image API"
May 26 00:07:41.721372 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.721355    2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 00:07:41.723728 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.723709    2560 fs.go:135] Filesystem UUIDs: map[324b85bb-6d51-4986-82ca-4eaab13d0bd3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9ccda024-72d6-48c3-8605-1747cd8abdf4:/dev/nvme0n1p4]
May 26 00:07:41.723772 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.723729    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 00:07:41.728611 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.728499    2560 manager.go:217] Machine: {Timestamp:2026-05-26 00:07:41.728017697 +0000 UTC m=+0.476058907 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104669 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2adaaf60165ab9100a8740d1712c6e SystemUUID:ec2adaaf-6016-5ab9-100a-8740d1712c6e BootID:1d9bdbcb-5a75-418d-9b56-208f771a77ee Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:fd:15:2a:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:fd:15:2a:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:88:cd:f4:d8:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 00:07:41.728715 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.728642    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 00:07:41.728749 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.728718    2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 00:07:41.729867 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.729846    2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 00:07:41.730002 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.729870    2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 00:07:41.730045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.730011    2560 topology_manager.go:138] "Creating topology manager with none policy"
May 26 00:07:41.730045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.730019    2560 container_manager_linux.go:306] "Creating device plugin manager"
May 26 00:07:41.730045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.730026    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 00:07:41.730913 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.730903    2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 00:07:41.732513 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.732502    2560 state_mem.go:36] "Initialized new in-memory state store"
May 26 00:07:41.732593 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.732579    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hwdr9"
May 26 00:07:41.732642 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.732622    2560 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 00:07:41.735346 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.735336    2560 kubelet.go:491] "Attempting to sync node with API server"
May 26 00:07:41.735382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.735350    2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 00:07:41.735382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.735363    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 00:07:41.735382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.735372    2560 kubelet.go:397] "Adding apiserver pod source"
May 26 00:07:41.735382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.735381    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 00:07:41.736567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.736555    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 00:07:41.736624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.736573    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 00:07:41.739283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.739266    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hwdr9"
May 26 00:07:41.739722 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.739708    2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 00:07:41.742350 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.742336    2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 00:07:41.743299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743283    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743308    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743318    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743327    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743339    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743347    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 00:07:41.743354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743356    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 00:07:41.743531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743365    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 00:07:41.743531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743377    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 00:07:41.743531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743386    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 00:07:41.743531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743409    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 00:07:41.743679 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.743667    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 00:07:41.744716 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.744705    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 00:07:41.744754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.744717    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 00:07:41.747916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.747902    2560 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 00:07:41.747979 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.747936    2560 server.go:1295] "Started kubelet"
May 26 00:07:41.748088 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.748009    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 00:07:41.748142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.748074    2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 00:07:41.748142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.748129    2560 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 00:07:41.748777 ip-10-0-131-165 systemd[1]: Started Kubernetes Kubelet.
May 26 00:07:41.749307 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.749182    2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.750130 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.750113    2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 00:07:41.752053 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.752032    2560 server.go:317] "Adding debug handlers to kubelet server"
May 26 00:07:41.752840 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.752822    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-165.ec2.internal" not found
May 26 00:07:41.753937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.753916    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.757435 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.757418    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 00:07:41.758149 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758135    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 00:07:41.758252 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758240    2560 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 00:07:41.758314 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758257    2560 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 00:07:41.758549 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758530    2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 00:07:41.758647 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758622    2560 reconstruct.go:97] "Volume reconstruction finished"
May 26 00:07:41.758647 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.758635    2560 reconciler.go:26] "Reconciler: start to sync state"
May 26 00:07:41.759995 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.759971    2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 00:07:41.760083 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.760013    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-165.ec2.internal\" not found"
May 26 00:07:41.760125 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760116    2560 factory.go:55] Registering systemd factory
May 26 00:07:41.760177 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760133    2560 factory.go:223] Registration of the systemd container factory successfully
May 26 00:07:41.760384 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760368    2560 factory.go:153] Registering CRI-O factory
May 26 00:07:41.760384 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760384    2560 factory.go:223] Registration of the crio container factory successfully
May 26 00:07:41.760476 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760436    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 00:07:41.760476 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760457    2560 factory.go:103] Registering Raw factory
May 26 00:07:41.760476 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760470    2560 manager.go:1196] Started watching for new ooms in manager
May 26 00:07:41.760943 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.760924    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.761741 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.761721    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-165.ec2.internal\" not found" node="ip-10-0-131-165.ec2.internal"
May 26 00:07:41.762171 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.762153    2560 manager.go:319] Starting recovery of all containers
May 26 00:07:41.766304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.766282    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-165.ec2.internal" not found
May 26 00:07:41.766423 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.766379    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 00:07:41.771898 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.771856    2560 manager.go:324] Recovery completed
May 26 00:07:41.776413 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.776401    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:41.778608 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.778570    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:41.778678 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.778630    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:41.778678 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.778646    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:41.779047 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.779035    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 00:07:41.779108 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.779046    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 00:07:41.779108 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.779065    2560 state_mem.go:36] "Initialized new in-memory state store"
May 26 00:07:41.782658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.782644    2560 policy_none.go:49] "None policy: Start"
May 26 00:07:41.782733 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.782662    2560 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 00:07:41.782733 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.782675    2560 state_mem.go:35] "Initializing new in-memory state store"
May 26 00:07:41.823441 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.823423    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-165.ec2.internal" not found
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828170    2560 manager.go:341] "Starting Device Plugin manager"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.828196    2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828205    2560 server.go:85] "Starting device plugin registration server"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828463    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828475    2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828587    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828668    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.828678    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.829238    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 00:07:41.842777 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.829274    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-165.ec2.internal\" not found"
May 26 00:07:41.856083 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.856059    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 00:07:41.856083 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.856081    2560 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 00:07:41.856199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.856095    2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 00:07:41.856199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.856102    2560 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 00:07:41.856199 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.856169    2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 00:07:41.862525 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.862508    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.928923 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.928856    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:41.929750 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.929732    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:41.929836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.929767    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:41.929836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.929778    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:41.929836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.929801    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-165.ec2.internal"
May 26 00:07:41.938286 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.938268    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-165.ec2.internal"
May 26 00:07:41.938384 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:41.938294    2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-165.ec2.internal\": node \"ip-10-0-131-165.ec2.internal\" not found"
May 26 00:07:41.956725 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.956688    2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"]
May 26 00:07:41.958836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.958819    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:41.958921 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.958907    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:41.958964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.958922    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:41.983103 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.983082    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:41.986894 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.986879    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:41.991247 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:41.991231    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:42.050738 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.050715    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:42.053949 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.053934    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:42.054038 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.053978    2560 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.054038 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.053993    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.059708 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.059688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.059782 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.059718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.059782 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.059736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccc3e4b1136a584073ab8921e325dd50-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"ccc3e4b1136a584073ab8921e325dd50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.067003 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.066991    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:42.067057 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.067020    2560 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160239    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160264    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccc3e4b1136a584073ab8921e325dd50-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"ccc3e4b1136a584073ab8921e325dd50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160280    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160322    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160348    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3131f38424e0ed70aff3a2a9103f0f98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal\" (UID: \"3131f38424e0ed70aff3a2a9103f0f98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.160416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.160353    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccc3e4b1136a584073ab8921e325dd50-config\") pod \"kube-apiserver-proxy-ip-10-0-131-165.ec2.internal\" (UID: \"ccc3e4b1136a584073ab8921e325dd50\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.294636 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.294411    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.353267 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.353242    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal"
May 26 00:07:42.657488 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.657412    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 00:07:42.658124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.657567    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 00:07:42.658124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.657594    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 00:07:42.658124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.657627    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 00:07:42.735560 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.735535    2560 apiserver.go:52] "Watching apiserver"
May 26 00:07:42.740947 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.740921    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 00:02:41 +0000 UTC" deadline="2027-11-10 14:11:36.335860871 +0000 UTC"
May 26 00:07:42.740947 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.740945    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12806h3m53.594917789s"
May 26 00:07:42.744023 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.744003    2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 00:07:42.744377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.744355    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dqrng","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-tjptx","openshift-network-diagnostics/network-check-target-cktzs","kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v","openshift-image-registry/node-ca-z65cf","openshift-multus/multus-w8hg5","openshift-multus/network-metrics-daemon-k4tkk","openshift-network-operator/iptables-alerter-xz2m9","openshift-ovn-kubernetes/ovnkube-node-r6gb6","kube-system/konnectivity-agent-vp8mw","openshift-cluster-node-tuning-operator/tuned-mpfvr"]
May 26 00:07:42.746932 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.746920    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.747975 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.747957    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.748954 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.748941    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:42.749019 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.748994    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:42.749318 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.749304    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 00:07:42.749363 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.749347    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 00:07:42.749503 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.749487    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 00:07:42.749894 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.749882    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 00:07:42.750001 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.749986    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.750035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.750006    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-znjcw\""
May 26 00:07:42.750136 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.750121    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.750754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.750737    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vr6kv\""
May 26 00:07:42.751114 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.751100    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.751305 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.751180    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 00:07:42.751305 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.751257    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 00:07:42.751305 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.751273    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 00:07:42.752270 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.752253    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.752696 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.752660    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:42.752836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.752819    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n6q2b\""
May 26 00:07:42.752836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.752830    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 00:07:42.752942 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.752878    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 00:07:42.753356 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.753339    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.753554    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.753774    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.753844    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.753970    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b2jt\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.754091    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 00:07:42.754355 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.754201    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6vfnw\""
May 26 00:07:42.755753 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.755736    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.755933 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.755913    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.757066 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.757048    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.758148 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.758134    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 00:07:42.758243 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.758161    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.758737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.758559    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 00:07:42.758737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.758583    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 00:07:42.758737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.758654    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 00:07:42.759568 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.759552    2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 00:07:42.760093 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760062    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 00:07:42.760093 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760067    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dw5tg\""
May 26 00:07:42.760233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760053    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 00:07:42.760233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760106    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 00:07:42.760233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760201    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 00:07:42.760365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760262    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 00:07:42.760365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760282    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 00:07:42.760365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760339    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cffg9\""
May 26 00:07:42.760365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760363    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 00:07:42.760556 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760369    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 00:07:42.760556 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.760340    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mwgnd\""
May 26 00:07:42.762146 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762125    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 00:07:42.762257 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762237    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pk84j\""
May 26 00:07:42.762390 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-netns\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.762475 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.762475 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354a28fe-146a-49ac-93a3-a43ac8603acb-hosts-file\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.762475 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-slash\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.762624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-bin\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.762624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.762624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7gk\" (UniqueName: \"kubernetes.io/projected/23edeb57-7426-44a3-8605-79309b6d0ab4-kube-api-access-vj7gk\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.762624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-os-release\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.762624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-k8s-cni-cncf-io\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhjq\" (UniqueName: \"kubernetes.io/projected/e7faca6d-4076-49b5-925e-9e8e7f92479e-kube-api-access-nlhjq\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-bin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-multus-certs\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-etc-kubernetes\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdbt4\" (UniqueName: \"kubernetes.io/projected/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-kube-api-access-xdbt4\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9232be98-f6ed-4113-a5e7-8285088ee9e5-iptables-alerter-script\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.762824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-conf\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-systemd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.762992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-serviceca\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763050    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9232be98-f6ed-4113-a5e7-8285088ee9e5-host-slash\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-run\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-tmp\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354a28fe-146a-49ac-93a3-a43ac8603acb-tmp-dir\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-node-log\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-lib-modules\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-var-lib-kubelet\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-etc-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-netd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-env-overrides\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-kubelet\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-device-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dz5\" (UniqueName: \"kubernetes.io/projected/9232be98-f6ed-4113-a5e7-8285088ee9e5-kube-api-access-v4dz5\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-ovn\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77ef692d-47f8-45fb-8e4f-a205a8ff6615-agent-certs\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.763573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77ef692d-47f8-45fb-8e4f-a205a8ff6615-konnectivity-ca\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-hostroot\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-var-lib-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-modprobe-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-host\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-cni-binary-copy\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-conf-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysconfig\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-kubernetes\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-system-cni-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-system-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-host\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9fs\" (UniqueName: \"kubernetes.io/projected/3b743cdc-f2ac-44ff-b936-adad789e96b2-kube-api-access-bs9fs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-systemd\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-sys\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-log-socket\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.763997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg9d\" (UniqueName: \"kubernetes.io/projected/496bd1dd-899a-4375-ade8-705209198b1c-kube-api-access-dlg9d\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.763993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23edeb57-7426-44a3-8605-79309b6d0ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-cnibin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c644h\" (UniqueName: \"kubernetes.io/projected/d0f151e6-7404-42de-80ea-4fd7752431ce-kube-api-access-c644h\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-config\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-socket-dir-parent\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb4gv\" (UniqueName: \"kubernetes.io/projected/1df9572f-515c-4263-801e-f16db97510f9-kube-api-access-qb4gv\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-os-release\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-sys-fs\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vpx\" (UniqueName: \"kubernetes.io/projected/354a28fe-146a-49ac-93a3-a43ac8603acb-kube-api-access-44vpx\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-multus\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-netns\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-cnibin\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-registration-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.764461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-daemon-config\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-script-lib\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-socket-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-etc-tuned\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-kubelet\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.764963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.764445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-systemd-units\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.770356 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.770339    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 00:07:42.787072 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.787041    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5gzh"
May 26 00:07:42.792493 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.792475    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5gzh"
May 26 00:07:42.864726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864694    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864741    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-ovn\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864769    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77ef692d-47f8-45fb-8e4f-a205a8ff6615-agent-certs\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864792    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77ef692d-47f8-45fb-8e4f-a205a8ff6615-konnectivity-ca\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864818    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-hostroot\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864821    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.864887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864841    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-var-lib-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864907    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-var-lib-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864924    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-hostroot\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864950    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-ovn\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.864967    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-modprobe-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865021    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-host\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865045    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-cni-binary-copy\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865061    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-conf-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865075    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-modprobe-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865080    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysconfig\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865126    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-kubernetes\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865130    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-conf-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865153    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-system-cni-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865149    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-host\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865129    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysconfig\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865179    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.865180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865183    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-kubernetes\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865211    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-system-cni-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865224    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865206    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-system-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865272    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865278    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-host\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865313    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-host\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865321    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9fs\" (UniqueName: \"kubernetes.io/projected/3b743cdc-f2ac-44ff-b936-adad789e96b2-kube-api-access-bs9fs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865342    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-system-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865350    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-systemd\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865378    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-sys\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865403    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-log-socket\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865413    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-systemd\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865428    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg9d\" (UniqueName: \"kubernetes.io/projected/496bd1dd-899a-4375-ade8-705209198b1c-kube-api-access-dlg9d\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865462    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77ef692d-47f8-45fb-8e4f-a205a8ff6615-konnectivity-ca\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865474    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-sys\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865506    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23edeb57-7426-44a3-8605-79309b6d0ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865534    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-cnibin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.865940 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865581    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-cnibin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865593    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-log-socket\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865641    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c644h\" (UniqueName: \"kubernetes.io/projected/d0f151e6-7404-42de-80ea-4fd7752431ce-kube-api-access-c644h\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865657    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-cni-binary-copy\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865688    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-config\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865714    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-socket-dir-parent\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865736    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb4gv\" (UniqueName: \"kubernetes.io/projected/1df9572f-515c-4263-801e-f16db97510f9-kube-api-access-qb4gv\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865762    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-os-release\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865813    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-socket-dir-parent\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865847    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865874    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-sys-fs\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865892    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-os-release\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865899    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44vpx\" (UniqueName: \"kubernetes.io/projected/354a28fe-146a-49ac-93a3-a43ac8603acb-kube-api-access-44vpx\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865953    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-multus\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865988    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866002    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-netns\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.866790 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866032    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-multus\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.865957    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-sys-fs\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866030    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-cnibin\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866079    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-netns\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866089    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-registration-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866117    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-daemon-config\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866122    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-cnibin\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866141    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-script-lib\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866164    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-socket-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866189    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866213    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-etc-tuned\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866245    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-kubelet\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866257    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-config\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866268    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-systemd-units\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866296    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-netns\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866339    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866367    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354a28fe-146a-49ac-93a3-a43ac8603acb-hosts-file\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.867506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866382    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-d\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866395    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-slash\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866415    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866473    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-bin\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866421    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-bin\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866515    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866543    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7gk\" (UniqueName: \"kubernetes.io/projected/23edeb57-7426-44a3-8605-79309b6d0ab4-kube-api-access-vj7gk\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866572    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-os-release\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866579    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-socket-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866618    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-k8s-cni-cncf-io\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866165    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-registration-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866642    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-daemon-config\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866650    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866678    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhjq\" (UniqueName: \"kubernetes.io/projected/e7faca6d-4076-49b5-925e-9e8e7f92479e-kube-api-access-nlhjq\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866692    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-ovnkube-script-lib\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866699    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-run-netns\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866704    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-bin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868297 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866716    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/354a28fe-146a-49ac-93a3-a43ac8603acb-hosts-file\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866745    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-cni-bin\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866760    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-multus-certs\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866766    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-os-release\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866789    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-k8s-cni-cncf-io\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866794    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-etc-kubernetes\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866806    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866824    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbt4\" (UniqueName: \"kubernetes.io/projected/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-kube-api-access-xdbt4\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866836    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7faca6d-4076-49b5-925e-9e8e7f92479e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866849    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9232be98-f6ed-4113-a5e7-8285088ee9e5-iptables-alerter-script\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866877    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-etc-kubernetes\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866897    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-conf\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866907    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-kubelet\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866926    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866938    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-systemd-units\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866995    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-systemd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.866959    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-systemd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.868937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867005    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-run-multus-certs\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867035    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867060    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-serviceca\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867085    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867112    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867132    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-slash\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867136    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9232be98-f6ed-4113-a5e7-8285088ee9e5-host-slash\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867161    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-run\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867188    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-tmp\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867214    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354a28fe-146a-49ac-93a3-a43ac8603acb-tmp-dir\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867237    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-node-log\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867264    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-lib-modules\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867289    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-var-lib-kubelet\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867316    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-etc-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867343    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867368    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-netd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867391    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-env-overrides\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867414    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-kubelet\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.869399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867440    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-device-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867463    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dz5\" (UniqueName: \"kubernetes.io/projected/9232be98-f6ed-4113-a5e7-8285088ee9e5-kube-api-access-v4dz5\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867496    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867115    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-etc-sysctl-conf\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867568    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9232be98-f6ed-4113-a5e7-8285088ee9e5-iptables-alerter-script\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867578    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9232be98-f6ed-4113-a5e7-8285088ee9e5-host-slash\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.867659    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.867716    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:43.367702434 +0000 UTC m=+2.115743666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867810    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-var-lib-kubelet\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867798    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-etc-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-run-openvswitch\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867892    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-multus-cni-dir\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867907    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-host-cni-netd\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867943    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-run\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.867980    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/354a28fe-146a-49ac-93a3-a43ac8603acb-tmp-dir\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868013    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23edeb57-7426-44a3-8605-79309b6d0ab4-node-log\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868067    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1df9572f-515c-4263-801e-f16db97510f9-lib-modules\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.869936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868146    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/496bd1dd-899a-4375-ade8-705209198b1c-device-dir\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868172    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f151e6-7404-42de-80ea-4fd7752431ce-host-var-lib-kubelet\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868285    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23edeb57-7426-44a3-8605-79309b6d0ab4-env-overrides\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868538    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-serviceca\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868677    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23edeb57-7426-44a3-8605-79309b6d0ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868760    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77ef692d-47f8-45fb-8e4f-a205a8ff6615-agent-certs\") pod \"konnectivity-agent-vp8mw\" (UID: \"77ef692d-47f8-45fb-8e4f-a205a8ff6615\") " pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868794    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-etc-tuned\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.868794    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7faca6d-4076-49b5-925e-9e8e7f92479e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.870382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.870182    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1df9572f-515c-4263-801e-f16db97510f9-tmp\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.874031 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.873918    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vpx\" (UniqueName: \"kubernetes.io/projected/354a28fe-146a-49ac-93a3-a43ac8603acb-kube-api-access-44vpx\") pod \"node-resolver-dqrng\" (UID: \"354a28fe-146a-49ac-93a3-a43ac8603acb\") " pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:42.874031 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.873988    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9fs\" (UniqueName: \"kubernetes.io/projected/3b743cdc-f2ac-44ff-b936-adad789e96b2-kube-api-access-bs9fs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:42.874192 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.874030    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg9d\" (UniqueName: \"kubernetes.io/projected/496bd1dd-899a-4375-ade8-705209198b1c-kube-api-access-dlg9d\") pod \"aws-ebs-csi-driver-node-jcx8v\" (UID: \"496bd1dd-899a-4375-ade8-705209198b1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:42.874349 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.874327    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c644h\" (UniqueName: \"kubernetes.io/projected/d0f151e6-7404-42de-80ea-4fd7752431ce-kube-api-access-c644h\") pod \"multus-w8hg5\" (UID: \"d0f151e6-7404-42de-80ea-4fd7752431ce\") " pod="openshift-multus/multus-w8hg5"
May 26 00:07:42.874528 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.874512    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb4gv\" (UniqueName: \"kubernetes.io/projected/1df9572f-515c-4263-801e-f16db97510f9-kube-api-access-qb4gv\") pod \"tuned-mpfvr\" (UID: \"1df9572f-515c-4263-801e-f16db97510f9\") " pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.875585 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.875558    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbt4\" (UniqueName: \"kubernetes.io/projected/816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9-kube-api-access-xdbt4\") pod \"node-ca-z65cf\" (UID: \"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9\") " pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:42.875744 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.875726    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dz5\" (UniqueName: \"kubernetes.io/projected/9232be98-f6ed-4113-a5e7-8285088ee9e5-kube-api-access-v4dz5\") pod \"iptables-alerter-xz2m9\" (UID: \"9232be98-f6ed-4113-a5e7-8285088ee9e5\") " pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:42.875829 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.875810    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7gk\" (UniqueName: \"kubernetes.io/projected/23edeb57-7426-44a3-8605-79309b6d0ab4-kube-api-access-vj7gk\") pod \"ovnkube-node-r6gb6\" (UID: \"23edeb57-7426-44a3-8605-79309b6d0ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.875867 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.875810    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhjq\" (UniqueName: \"kubernetes.io/projected/e7faca6d-4076-49b5-925e-9e8e7f92479e-kube-api-access-nlhjq\") pod \"multus-additional-cni-plugins-tjptx\" (UID: \"e7faca6d-4076-49b5-925e-9e8e7f92479e\") " pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:42.876887 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.876867    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:42.876968 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.876893    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:42.876968 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.876906    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:42.876968 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:42.876959    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:07:43.376940127 +0000 UTC m=+2.124981338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:42.890434 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.890416    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:07:42.897692 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.897673    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:07:42.901765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.901749    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mpfvr"
May 26 00:07:42.982444 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:42.982409    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3131f38424e0ed70aff3a2a9103f0f98.slice/crio-c3d2fb31f1b6476947c42f431f02286e0c6e622d4c4ef2f9bc7507d7cb1a1717 WatchSource:0}: Error finding container c3d2fb31f1b6476947c42f431f02286e0c6e622d4c4ef2f9bc7507d7cb1a1717: Status 404 returned error can't find the container with id c3d2fb31f1b6476947c42f431f02286e0c6e622d4c4ef2f9bc7507d7cb1a1717
May 26 00:07:42.982631 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:42.982615    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc3e4b1136a584073ab8921e325dd50.slice/crio-15c7eacbc449ba9007e163b1dc0b5784da259ee5662eb7ad5e7907fae6b6725d WatchSource:0}: Error finding container 15c7eacbc449ba9007e163b1dc0b5784da259ee5662eb7ad5e7907fae6b6725d: Status 404 returned error can't find the container with id 15c7eacbc449ba9007e163b1dc0b5784da259ee5662eb7ad5e7907fae6b6725d
May 26 00:07:42.986233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:42.986217    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:07:43.076036 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.076007    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w8hg5"
May 26 00:07:43.082494 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.082472    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f151e6_7404_42de_80ea_4fd7752431ce.slice/crio-7bbd30f47ea3a39d29837abdd454add7f59b659721e1a81fe6a9758c8c880a6f WatchSource:0}: Error finding container 7bbd30f47ea3a39d29837abdd454add7f59b659721e1a81fe6a9758c8c880a6f: Status 404 returned error can't find the container with id 7bbd30f47ea3a39d29837abdd454add7f59b659721e1a81fe6a9758c8c880a6f
May 26 00:07:43.092517 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.092493    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z65cf"
May 26 00:07:43.098232 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.098211    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816dbe6c_385b_4bfe_bcbd_8fb1d78f02d9.slice/crio-6586684f1443d4fb4998d042185b85550232d9864b5111b31f010f0bcfbee746 WatchSource:0}: Error finding container 6586684f1443d4fb4998d042185b85550232d9864b5111b31f010f0bcfbee746: Status 404 returned error can't find the container with id 6586684f1443d4fb4998d042185b85550232d9864b5111b31f010f0bcfbee746
May 26 00:07:43.112200 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.112179    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tjptx"
May 26 00:07:43.117911 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.117886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7faca6d_4076_49b5_925e_9e8e7f92479e.slice/crio-2639d7b35d806d224830efbaa63c2a81fd2326a18fe594ca163b4d8c55ad0ec8 WatchSource:0}: Error finding container 2639d7b35d806d224830efbaa63c2a81fd2326a18fe594ca163b4d8c55ad0ec8: Status 404 returned error can't find the container with id 2639d7b35d806d224830efbaa63c2a81fd2326a18fe594ca163b4d8c55ad0ec8
May 26 00:07:43.128899 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.128881    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v"
May 26 00:07:43.134543 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.134522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496bd1dd_899a_4375_ade8_705209198b1c.slice/crio-141fd846d37c73d755b250c036904f6ae26e226e569add61e890d01798f4ad8e WatchSource:0}: Error finding container 141fd846d37c73d755b250c036904f6ae26e226e569add61e890d01798f4ad8e: Status 404 returned error can't find the container with id 141fd846d37c73d755b250c036904f6ae26e226e569add61e890d01798f4ad8e
May 26 00:07:43.148382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.148363    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dqrng"
May 26 00:07:43.153845 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.153825    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354a28fe_146a_49ac_93a3_a43ac8603acb.slice/crio-b30fbc2e09708f8d8770c9b6243f3b5ce03154504bb8521fb37019a3cbc535de WatchSource:0}: Error finding container b30fbc2e09708f8d8770c9b6243f3b5ce03154504bb8521fb37019a3cbc535de: Status 404 returned error can't find the container with id b30fbc2e09708f8d8770c9b6243f3b5ce03154504bb8521fb37019a3cbc535de
May 26 00:07:43.155795 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.155776    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xz2m9"
May 26 00:07:43.161233 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.161211    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9232be98_f6ed_4113_a5e7_8285088ee9e5.slice/crio-a7b7671aa4a440d5cb35728c376a65d1847f1ca0fa57e81d80be7d7c8709bdf3 WatchSource:0}: Error finding container a7b7671aa4a440d5cb35728c376a65d1847f1ca0fa57e81d80be7d7c8709bdf3: Status 404 returned error can't find the container with id a7b7671aa4a440d5cb35728c376a65d1847f1ca0fa57e81d80be7d7c8709bdf3
May 26 00:07:43.186636 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.186616    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23edeb57_7426_44a3_8605_79309b6d0ab4.slice/crio-8ab1323d2a45ca3975fdd20036dc1478b20cfcd40c082b8704e713df5fffd889 WatchSource:0}: Error finding container 8ab1323d2a45ca3975fdd20036dc1478b20cfcd40c082b8704e713df5fffd889: Status 404 returned error can't find the container with id 8ab1323d2a45ca3975fdd20036dc1478b20cfcd40c082b8704e713df5fffd889
May 26 00:07:43.226408 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.226383    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ef692d_47f8_45fb_8e4f_a205a8ff6615.slice/crio-16f707610e65fb64f4d3c0a1fea188f14aee4e2278aacd6df85368556d10e838 WatchSource:0}: Error finding container 16f707610e65fb64f4d3c0a1fea188f14aee4e2278aacd6df85368556d10e838: Status 404 returned error can't find the container with id 16f707610e65fb64f4d3c0a1fea188f14aee4e2278aacd6df85368556d10e838
May 26 00:07:43.276243 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:07:43.276220    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df9572f_515c_4263_801e_f16db97510f9.slice/crio-2ef6f608125b0d5ffab3ca465834a893c7f9505f3727db402a204c6078f46118 WatchSource:0}: Error finding container 2ef6f608125b0d5ffab3ca465834a893c7f9505f3727db402a204c6078f46118: Status 404 returned error can't find the container with id 2ef6f608125b0d5ffab3ca465834a893c7f9505f3727db402a204c6078f46118
May 26 00:07:43.370764 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.370729    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:43.370917 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.370869    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:43.370991 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.370939    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:44.370922006 +0000 UTC m=+3.118963210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:43.465381 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.465349    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:43.471806 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.471770    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:43.472002 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.471972    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:43.472002 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.471997    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:43.472119 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.472009    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:43.472119 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:43.472074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:07:44.472053708 +0000 UTC m=+3.220094919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:43.787329 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.787017    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:43.793551 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.793466    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 00:02:42 +0000 UTC" deadline="2027-11-11 23:30:36.371381462 +0000 UTC"
May 26 00:07:43.793551 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.793498    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12839h22m52.577887341s"
May 26 00:07:43.867267 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.867205    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp8mw" event={"ID":"77ef692d-47f8-45fb-8e4f-a205a8ff6615","Type":"ContainerStarted","Data":"16f707610e65fb64f4d3c0a1fea188f14aee4e2278aacd6df85368556d10e838"}
May 26 00:07:43.870721 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.870687    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"8ab1323d2a45ca3975fdd20036dc1478b20cfcd40c082b8704e713df5fffd889"}
May 26 00:07:43.883426 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.883402    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:43.886532 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.886503    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xz2m9" event={"ID":"9232be98-f6ed-4113-a5e7-8285088ee9e5","Type":"ContainerStarted","Data":"a7b7671aa4a440d5cb35728c376a65d1847f1ca0fa57e81d80be7d7c8709bdf3"}
May 26 00:07:43.915780 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.915745    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v" event={"ID":"496bd1dd-899a-4375-ade8-705209198b1c","Type":"ContainerStarted","Data":"141fd846d37c73d755b250c036904f6ae26e226e569add61e890d01798f4ad8e"}
May 26 00:07:43.927738 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.927706    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z65cf" event={"ID":"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9","Type":"ContainerStarted","Data":"6586684f1443d4fb4998d042185b85550232d9864b5111b31f010f0bcfbee746"}
May 26 00:07:43.944125 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.944091    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dqrng" event={"ID":"354a28fe-146a-49ac-93a3-a43ac8603acb","Type":"ContainerStarted","Data":"b30fbc2e09708f8d8770c9b6243f3b5ce03154504bb8521fb37019a3cbc535de"}
May 26 00:07:43.949152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.947424    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerStarted","Data":"2639d7b35d806d224830efbaa63c2a81fd2326a18fe594ca163b4d8c55ad0ec8"}
May 26 00:07:43.972758 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.972195    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w8hg5" event={"ID":"d0f151e6-7404-42de-80ea-4fd7752431ce","Type":"ContainerStarted","Data":"7bbd30f47ea3a39d29837abdd454add7f59b659721e1a81fe6a9758c8c880a6f"}
May 26 00:07:43.980389 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.980357    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" event={"ID":"ccc3e4b1136a584073ab8921e325dd50","Type":"ContainerStarted","Data":"15c7eacbc449ba9007e163b1dc0b5784da259ee5662eb7ad5e7907fae6b6725d"}
May 26 00:07:43.986676 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.986647    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"3131f38424e0ed70aff3a2a9103f0f98","Type":"ContainerStarted","Data":"c3d2fb31f1b6476947c42f431f02286e0c6e622d4c4ef2f9bc7507d7cb1a1717"}
May 26 00:07:43.991321 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:43.991288    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mpfvr" event={"ID":"1df9572f-515c-4263-801e-f16db97510f9","Type":"ContainerStarted","Data":"2ef6f608125b0d5ffab3ca465834a893c7f9505f3727db402a204c6078f46118"}
May 26 00:07:44.379144 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.379112    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:44.379331 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.379270    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:44.379394 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.379341    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:46.379322313 +0000 UTC m=+5.127363526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:44.479976 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.479860    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:44.480230 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.480046    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:44.480230 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.480074    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:44.480230 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.480096    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:44.480230 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.480158    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:07:46.480137864 +0000 UTC m=+5.228179067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:44.794283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.794106    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 00:02:42 +0000 UTC" deadline="2027-12-13 13:19:17.041843452 +0000 UTC"
May 26 00:07:44.794283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.794147    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13597h11m32.247699689s"
May 26 00:07:44.857295 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.857263    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:44.857480 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.857436    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:44.857910 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:44.857889    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:44.858003 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:44.857983    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:46.399216 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:46.399137    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:46.399665 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.399306    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:46.399665 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.399377    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:50.39935561 +0000 UTC m=+9.147396814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:46.500351 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:46.500313    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:46.500538 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.500514    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:46.500538 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.500532    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:46.500672 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.500544    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:46.500672 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.500618    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:07:50.50058471 +0000 UTC m=+9.248625913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:46.857348 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:46.857265    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:46.857512 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.857410    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:46.857985 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:46.857829    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:46.857985 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:46.857927    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:48.856451 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:48.856397    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:48.856925 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:48.856535    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:48.856997 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:48.856967    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:48.857088 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:48.857064    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:50.433504 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:50.432956    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:50.433504 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.433126    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:50.433504 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.433190    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:58.433170658 +0000 UTC m=+17.181211860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:50.534053 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:50.534010    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:50.534241 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.534212    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:50.534241 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.534232    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:50.534355 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.534246    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:50.534355 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.534309    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:07:58.534290448 +0000 UTC m=+17.282331648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:50.857452 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:50.857357    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:50.857650 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:50.857365    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:50.857650 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.857498    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:50.857650 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:50.857610    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:52.857301 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:52.857264    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:52.857693 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:52.857264    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:52.857693 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:52.857427    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:52.857693 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:52.857500    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:54.856530 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:54.856491    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:54.856989 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:54.856630    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:54.856989 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:54.856672    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:54.856989 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:54.856778    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:56.856813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:56.856775    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:56.857210 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:56.856775    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:56.857210 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:56.856920    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:07:56.857210 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:56.856963    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:58.492269 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:58.492229    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:58.492774 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.492355    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:58.492774 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.492438    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:14.492413504 +0000 UTC m=+33.240454716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:58.593222 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:58.593176    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:58.593439 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.593380    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:58.593439 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.593404    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:58.593439 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.593418    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:58.593590 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.593479    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:08:14.593459635 +0000 UTC m=+33.341500836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:58.856349 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:58.856270    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:07:58.856503 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:07:58.856270    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:07:58.856503 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.856413    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:07:58.856503 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:07:58.856460    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:00.856501 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:00.856454    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:00.857083 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:00.856454    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:00.857083 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:00.856617    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:00.857083 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:00.856684    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:02.857145 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:02.856766    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:02.857942 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:02.857031    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:02.857942 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:02.857244    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:02.857942 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:02.857412    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:03.034753 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.034717    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mpfvr" event={"ID":"1df9572f-515c-4263-801e-f16db97510f9","Type":"ContainerStarted","Data":"b96b0fb0ac97ec5ea2610949a15a6568134d832c13db0c34bebc79e8fe4dcb39"}
May 26 00:08:03.035981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.035954    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vp8mw" event={"ID":"77ef692d-47f8-45fb-8e4f-a205a8ff6615","Type":"ContainerStarted","Data":"e9ec5228aa55a05d7424afaeac97de10fa520d061c9f6412adb105a988a19e35"}
May 26 00:08:03.038429 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038399    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"e03afc09c0aa1223ab6930b703387679faf11eab5429f2960a348a8844cdf7ff"}
May 26 00:08:03.038516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038431    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"497f306db911ede88a8c84a93b51608316f6c060bcf02f04d59d7a229a670d98"}
May 26 00:08:03.038516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038448    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"88c74fb58c4a81ba5aec5c429d6e0ebc4be2f734a287302baaf4d81b86eacf47"}
May 26 00:08:03.038516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038461    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"f20d5668bdeeb65f27ffb1de0106d9016a13d4bb239f8cbddd72455b408e1f00"}
May 26 00:08:03.038516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038472    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"b315e3dfec3deb6f7e5b75ab6ae57240e7b44dce08f9d7ccfa827bd63b684ba1"}
May 26 00:08:03.038516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.038486    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"359c57e5a6a9e97dca641dce53b435aaa45d727d0c7b77efd17b2f84fd6fd666"}
May 26 00:08:03.039648 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.039629    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v" event={"ID":"496bd1dd-899a-4375-ade8-705209198b1c","Type":"ContainerStarted","Data":"1fa0fd7dbe4e79ed57c99e0d6f48ba7403bc28bb519cc984cb01d69c74080bed"}
May 26 00:08:03.040731 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.040714    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z65cf" event={"ID":"816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9","Type":"ContainerStarted","Data":"4a0bea098534c108c8636e3a4aa76f2dfd64722460696de9b6e93128b21eb961"}
May 26 00:08:03.041935 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.041907    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dqrng" event={"ID":"354a28fe-146a-49ac-93a3-a43ac8603acb","Type":"ContainerStarted","Data":"26f53c5fcbeebaab1b2a04790c2609b3829214385867a8c51a3b9bc7973378bb"}
May 26 00:08:03.043242 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.043084    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="68a562a0c764db1325f0527cf80c6fc499780cab463995332f1489e92dd3af68" exitCode=0
May 26 00:08:03.043327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.043164    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"68a562a0c764db1325f0527cf80c6fc499780cab463995332f1489e92dd3af68"}
May 26 00:08:03.044659 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.044634    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w8hg5" event={"ID":"d0f151e6-7404-42de-80ea-4fd7752431ce","Type":"ContainerStarted","Data":"fc60650d4e9d120b098ff80de3e47a449efe72873cf8932efe42ef63453b0ddb"}
May 26 00:08:03.045859 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.045841    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" event={"ID":"ccc3e4b1136a584073ab8921e325dd50","Type":"ContainerStarted","Data":"cd0ee7070ceb4bd5f43d9d8fc4be9f3a011b784382a2060e21f2539c8014c3f9"}
May 26 00:08:03.047111 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.047085    2560 generic.go:358] "Generic (PLEG): container finished" podID="3131f38424e0ed70aff3a2a9103f0f98" containerID="217b9ada071f9d3739dd99697a573f87e9bd42e6aa45033735785d0e6cddb022" exitCode=0
May 26 00:08:03.047200 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.047120    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"3131f38424e0ed70aff3a2a9103f0f98","Type":"ContainerDied","Data":"217b9ada071f9d3739dd99697a573f87e9bd42e6aa45033735785d0e6cddb022"}
May 26 00:08:03.068624 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.068545    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mpfvr" podStartSLOduration=2.469101379 podStartE2EDuration="21.068532556s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.277722898 +0000 UTC m=+2.025764095" lastFinishedPulling="2026-05-26 00:08:01.87715407 +0000 UTC m=+20.625195272" observedRunningTime="2026-05-26 00:08:03.067922791 +0000 UTC m=+21.815964009" watchObservedRunningTime="2026-05-26 00:08:03.068532556 +0000 UTC m=+21.816573775"
May 26 00:08:03.103565 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.103505    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dqrng" podStartSLOduration=2.382226348 podStartE2EDuration="21.10348849s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.155626205 +0000 UTC m=+1.903667402" lastFinishedPulling="2026-05-26 00:08:01.876888347 +0000 UTC m=+20.624929544" observedRunningTime="2026-05-26 00:08:03.103481532 +0000 UTC m=+21.851522750" watchObservedRunningTime="2026-05-26 00:08:03.10348849 +0000 UTC m=+21.851529710"
May 26 00:08:03.120611 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.120542    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-w8hg5" podStartSLOduration=3.07731943 podStartE2EDuration="22.120524084s" podCreationTimestamp="2026-05-26 00:07:41 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.083992225 +0000 UTC m=+1.832033436" lastFinishedPulling="2026-05-26 00:08:02.127196893 +0000 UTC m=+20.875238090" observedRunningTime="2026-05-26 00:08:03.120200522 +0000 UTC m=+21.868241741" watchObservedRunningTime="2026-05-26 00:08:03.120524084 +0000 UTC m=+21.868565307"
May 26 00:08:03.134265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.134208    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vp8mw" podStartSLOduration=7.171118037 podStartE2EDuration="21.13418996s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.227762682 +0000 UTC m=+1.975803879" lastFinishedPulling="2026-05-26 00:07:57.190834591 +0000 UTC m=+15.938875802" observedRunningTime="2026-05-26 00:08:03.134181581 +0000 UTC m=+21.882222801" watchObservedRunningTime="2026-05-26 00:08:03.13418996 +0000 UTC m=+21.882231180"
May 26 00:08:03.146703 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.146645    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-165.ec2.internal" podStartSLOduration=22.146625748 podStartE2EDuration="22.146625748s" podCreationTimestamp="2026-05-26 00:07:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:08:03.146455307 +0000 UTC m=+21.894496550" watchObservedRunningTime="2026-05-26 00:08:03.146625748 +0000 UTC m=+21.894666971"
May 26 00:08:03.172930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.172874    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z65cf" podStartSLOduration=2.415677813 podStartE2EDuration="21.172858126s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.099534812 +0000 UTC m=+1.847576011" lastFinishedPulling="2026-05-26 00:08:01.856715125 +0000 UTC m=+20.604756324" observedRunningTime="2026-05-26 00:08:03.172541763 +0000 UTC m=+21.920582984" watchObservedRunningTime="2026-05-26 00:08:03.172858126 +0000 UTC m=+21.920899346"
May 26 00:08:03.184701 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.184643    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:08:03.185588 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.185560    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:08:03.574129 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.574077    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 00:08:03.840716 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.840520    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T00:08:03.574116073Z","UUID":"a413f08f-df8e-45a7-91ec-088292c9dc06","Handler":null,"Name":"","Endpoint":""}
May 26 00:08:03.842555 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.842516    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 00:08:03.842555 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:03.842551    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 00:08:04.051397 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.051356    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xz2m9" event={"ID":"9232be98-f6ed-4113-a5e7-8285088ee9e5","Type":"ContainerStarted","Data":"699e7bb984463a14e97073184a4436ed73a856ed0c3551891b0d60684e626688"}
May 26 00:08:04.053430 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.053399    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v" event={"ID":"496bd1dd-899a-4375-ade8-705209198b1c","Type":"ContainerStarted","Data":"100173b4ed31ed7a4892f4f2ed435f05f92967ae41433610b153cbb6667a26d2"}
May 26 00:08:04.055671 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.055590    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" event={"ID":"3131f38424e0ed70aff3a2a9103f0f98","Type":"ContainerStarted","Data":"ae8196fe91033b2466a6160442d75e3e9d0ea4876ede3b21e255af57f2466663"}
May 26 00:08:04.065797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.065744    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xz2m9" podStartSLOduration=3.397020021 podStartE2EDuration="22.065726589s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.163428079 +0000 UTC m=+1.911469289" lastFinishedPulling="2026-05-26 00:08:01.832134647 +0000 UTC m=+20.580175857" observedRunningTime="2026-05-26 00:08:04.065365146 +0000 UTC m=+22.813406366" watchObservedRunningTime="2026-05-26 00:08:04.065726589 +0000 UTC m=+22.813767807"
May 26 00:08:04.078811 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.078756    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-165.ec2.internal" podStartSLOduration=22.0787375 podStartE2EDuration="22.0787375s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:08:04.078298422 +0000 UTC m=+22.826339642" watchObservedRunningTime="2026-05-26 00:08:04.0787375 +0000 UTC m=+22.826778720"
May 26 00:08:04.856555 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.856529    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:04.856706 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:04.856525    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:04.856706 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:04.856675    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:04.856832 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:04.856810    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:05.061561 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:05.061518    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"0168ecd441e389d6ebc21067b132ab444e7b8f3ea24a43f9953037f9b993d68f"}
May 26 00:08:05.063727 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:05.063704    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 00:08:05.063727 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:05.063698    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v" event={"ID":"496bd1dd-899a-4375-ade8-705209198b1c","Type":"ContainerStarted","Data":"6290b2c34be5106630894cf071e3f34a97a4f1b148a490dfdaa01c9e8fd8ba69"}
May 26 00:08:05.084134 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:05.084080    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jcx8v" podStartSLOduration=1.637278233 podStartE2EDuration="23.084055983s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.135910751 +0000 UTC m=+1.883951949" lastFinishedPulling="2026-05-26 00:08:04.582688497 +0000 UTC m=+23.330729699" observedRunningTime="2026-05-26 00:08:05.083823174 +0000 UTC m=+23.831864406" watchObservedRunningTime="2026-05-26 00:08:05.084055983 +0000 UTC m=+23.832097203"
May 26 00:08:06.856765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:06.856556    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:06.857341 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:06.856556    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:06.857341 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:06.856868    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:06.857341 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:06.856926    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:07.936304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:07.936261    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:08:07.936853 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:07.936400    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 00:08:07.936935 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:07.936921    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vp8mw"
May 26 00:08:08.071435 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.071387    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" event={"ID":"23edeb57-7426-44a3-8605-79309b6d0ab4","Type":"ContainerStarted","Data":"1ef86cb1353a8cd1068c0ac520d8807f264c4f3d05ee551cb736fd88f0d53fdb"}
May 26 00:08:08.071749 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.071723    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:08.073149 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.073123    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="69367de13cae3963dc7c23a2877b59552d388d5269011e3c08d4aa0a1f37999a" exitCode=0
May 26 00:08:08.073263 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.073197    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"69367de13cae3963dc7c23a2877b59552d388d5269011e3c08d4aa0a1f37999a"}
May 26 00:08:08.087981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.087958    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:08.095521 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.095475    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" podStartSLOduration=7.366520038 podStartE2EDuration="26.095461522s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.187980006 +0000 UTC m=+1.936021204" lastFinishedPulling="2026-05-26 00:08:01.916921477 +0000 UTC m=+20.664962688" observedRunningTime="2026-05-26 00:08:08.095447157 +0000 UTC m=+26.843488387" watchObservedRunningTime="2026-05-26 00:08:08.095461522 +0000 UTC m=+26.843502719"
May 26 00:08:08.856353 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.856322    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:08.856519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:08.856322    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:08.856519 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:08.856464    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:08.856628 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:08.856507    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:09.018658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.018625    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cktzs"]
May 26 00:08:09.022669 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.022635    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k4tkk"]
May 26 00:08:09.076838 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.076769    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="f157b7888011b0a7d144b699e72209f7a7d6307e448b0035ffc4e1169e0fd039" exitCode=0
May 26 00:08:09.076993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.076877    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:09.076993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.076881    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"f157b7888011b0a7d144b699e72209f7a7d6307e448b0035ffc4e1169e0fd039"}
May 26 00:08:09.076993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.076949    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 00:08:09.077164 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:09.077143    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:09.078315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.077522    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:09.078315 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:09.077631    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:09.078315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.077660    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:09.093384 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:09.093362    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:10.081317 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.081068    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="1000c7570d31b827377c592bc5f182b2d6e2ee0fc74e24634f242d21d2f0a358" exitCode=0
May 26 00:08:10.081746 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.081152    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"1000c7570d31b827377c592bc5f182b2d6e2ee0fc74e24634f242d21d2f0a358"}
May 26 00:08:10.081746 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.081406    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 00:08:10.192811 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.192771    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:10.857017 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.856975    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:10.857210 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:10.856975    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:10.857210 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:10.857108    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:10.857317 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:10.857249    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:12.097582 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:12.097533    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6" podUID="23edeb57-7426-44a3-8605-79309b6d0ab4" containerName="ovnkube-controller" probeResult="failure" output=""
May 26 00:08:12.856685 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:12.856644    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:12.856868 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:12.856691    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:12.856868 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:12.856789    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:12.856956 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:12.856924    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:14.506011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:14.505973    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:14.506562 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.506141    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:08:14.506562 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.506209    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:46.506194658 +0000 UTC m=+65.254235855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:08:14.607008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:14.606949    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:14.607193 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.607126    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:08:14.607193 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.607148    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:08:14.607193 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.607158    2560 projected.go:194] Error preparing data for projected volume kube-api-access-jp7dj for pod openshift-network-diagnostics/network-check-target-cktzs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:08:14.607311 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.607212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj podName:8d24d6c7-9212-49b0-8a14-0fa836285fcf nodeName:}" failed. No retries permitted until 2026-05-26 00:08:46.607197556 +0000 UTC m=+65.355238753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp7dj" (UniqueName: "kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj") pod "network-check-target-cktzs" (UID: "8d24d6c7-9212-49b0-8a14-0fa836285fcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:08:14.857186 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:14.857093    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:14.857368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:14.857093    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:14.857368 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.857215    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cktzs" podUID="8d24d6c7-9212-49b0-8a14-0fa836285fcf"
May 26 00:08:14.857368 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:14.857328    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k4tkk" podUID="3b743cdc-f2ac-44ff-b936-adad789e96b2"
May 26 00:08:16.024371 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.024337    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-165.ec2.internal" event="NodeReady"
May 26 00:08:16.024772 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.024463    2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 00:08:16.066987 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.066950    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4rjj5"]
May 26 00:08:16.090851 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.090820    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6zlq6"]
May 26 00:08:16.091028 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.091003    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.093663 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.093626    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 00:08:16.093663 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.093640    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 00:08:16.093879 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.093690    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ln8c\""
May 26 00:08:16.109216 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.109186    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4rjj5"]
May 26 00:08:16.109216 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.109217    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zlq6"]
May 26 00:08:16.109411 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.109339    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.111967 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.111947    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 00:08:16.112091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.112007    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vc6m6\""
May 26 00:08:16.112157 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.112145    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 00:08:16.112206 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.112147    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 00:08:16.219360 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.219541 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013c46bf-8592-4a5a-80da-6d88abe8b20a-config-volume\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.219541 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013c46bf-8592-4a5a-80da-6d88abe8b20a-tmp-dir\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.219541 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfcbt\" (UniqueName: \"kubernetes.io/projected/013c46bf-8592-4a5a-80da-6d88abe8b20a-kube-api-access-nfcbt\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.219541 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.219739 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.219593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwkhj\" (UniqueName: \"kubernetes.io/projected/a4c72b19-dbf7-4a99-825a-b915659541fc-kube-api-access-nwkhj\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.320864 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320827    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320893    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013c46bf-8592-4a5a-80da-6d88abe8b20a-config-volume\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320916    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013c46bf-8592-4a5a-80da-6d88abe8b20a-tmp-dir\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfcbt\" (UniqueName: \"kubernetes.io/projected/013c46bf-8592-4a5a-80da-6d88abe8b20a-kube-api-access-nfcbt\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320954    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.320973    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwkhj\" (UniqueName: \"kubernetes.io/projected/a4c72b19-dbf7-4a99-825a-b915659541fc-kube-api-access-nwkhj\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.321040 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.320973    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:16.321299 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.321046    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:16.821024852 +0000 UTC m=+35.569066054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:16.321299 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.321109    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:16.321299 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.321179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:16.82116149 +0000 UTC m=+35.569202705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:16.321299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.321274    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013c46bf-8592-4a5a-80da-6d88abe8b20a-tmp-dir\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.321489 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.321473    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/013c46bf-8592-4a5a-80da-6d88abe8b20a-config-volume\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.331165 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.331144    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwkhj\" (UniqueName: \"kubernetes.io/projected/a4c72b19-dbf7-4a99-825a-b915659541fc-kube-api-access-nwkhj\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.331247 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.331162    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfcbt\" (UniqueName: \"kubernetes.io/projected/013c46bf-8592-4a5a-80da-6d88abe8b20a-kube-api-access-nfcbt\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.826401 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.826170    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:16.826401 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.826374    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:16.826621 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.826314    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:16.826621 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.826447    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:16.826621 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.826465    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:17.826448853 +0000 UTC m=+36.574490049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:16.826621 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:16.826486    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:17.826474795 +0000 UTC m=+36.574515992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:16.857098 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.857064    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:16.857253 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.857065    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:16.859664 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.859646    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkcd9\""
May 26 00:08:16.859766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.859666    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 00:08:16.859766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.859691    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6mqgt\""
May 26 00:08:16.860990 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.860969    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 00:08:16.861123 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:16.861010    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 00:08:17.096353 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:17.096274    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="bddf69a2bddb57731b259ad6789caaac703582f706838db22cb4ddcce2a73cfa" exitCode=0
May 26 00:08:17.096353 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:17.096343    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"bddf69a2bddb57731b259ad6789caaac703582f706838db22cb4ddcce2a73cfa"}
May 26 00:08:17.835304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:17.835256    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:17.835484 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:17.835326    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:17.835484 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:17.835401    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:17.835484 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:17.835406    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:17.835484 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:17.835455    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:19.835441388 +0000 UTC m=+38.583482585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:17.835484 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:17.835470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:19.835463846 +0000 UTC m=+38.583505042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:18.101233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:18.101148    2560 generic.go:358] "Generic (PLEG): container finished" podID="e7faca6d-4076-49b5-925e-9e8e7f92479e" containerID="d2d27532eac2801a0d43eb50e4a442cfac9906e944e895ad789ff85068ef893a" exitCode=0
May 26 00:08:18.101233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:18.101208    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerDied","Data":"d2d27532eac2801a0d43eb50e4a442cfac9906e944e895ad789ff85068ef893a"}
May 26 00:08:19.106161 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:19.106130    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tjptx" event={"ID":"e7faca6d-4076-49b5-925e-9e8e7f92479e","Type":"ContainerStarted","Data":"13b2661a4928020c7d270d20443ad7429eca070c3712366320042599d9f5568d"}
May 26 00:08:19.129281 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:19.129225    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tjptx" podStartSLOduration=3.947349719 podStartE2EDuration="37.129208919s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:07:43.119361368 +0000 UTC m=+1.867402565" lastFinishedPulling="2026-05-26 00:08:16.301220569 +0000 UTC m=+35.049261765" observedRunningTime="2026-05-26 00:08:19.127294009 +0000 UTC m=+37.875335225" watchObservedRunningTime="2026-05-26 00:08:19.129208919 +0000 UTC m=+37.877250137"
May 26 00:08:19.850794 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:19.850758    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:19.850979 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:19.850814    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:19.850979 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:19.850907    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:19.850979 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:19.850909    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:19.850979 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:19.850963    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:23.850945195 +0000 UTC m=+42.598986392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:19.851124 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:19.850997    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:23.850971407 +0000 UTC m=+42.599012603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:23.878852 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:23.878812    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:23.879258 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:23.878870    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:23.879258 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:23.878961    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:23.879258 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:23.878961    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:23.879258 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:23.879010    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:31.878996536 +0000 UTC m=+50.627037732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:23.879258 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:23.879023    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:31.879016759 +0000 UTC m=+50.627057956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:31.939050 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:31.939011    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:31.939579 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:31.939084    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:31.939579 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:31.939177    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:31.939579 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:31.939242    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:08:47.939227642 +0000 UTC m=+66.687268840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:31.939579 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:31.939177    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:31.939579 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:31.939302    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:08:47.939290014 +0000 UTC m=+66.687331227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:42.094965 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:42.094926    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6gb6"
May 26 00:08:46.538172 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.538131    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:08:46.540936 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.540916    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 00:08:46.548559 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:46.548537    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 00:08:46.548631 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:46.548613    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs podName:3b743cdc-f2ac-44ff-b936-adad789e96b2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:50.548585032 +0000 UTC m=+129.296626229 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs") pod "network-metrics-daemon-k4tkk" (UID: "3b743cdc-f2ac-44ff-b936-adad789e96b2") : secret "metrics-daemon-secret" not found
May 26 00:08:46.639064 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.639029    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:46.642021 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.642004    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 00:08:46.652418 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.652397    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 00:08:46.663715 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.663688    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7dj\" (UniqueName: \"kubernetes.io/projected/8d24d6c7-9212-49b0-8a14-0fa836285fcf-kube-api-access-jp7dj\") pod \"network-check-target-cktzs\" (UID: \"8d24d6c7-9212-49b0-8a14-0fa836285fcf\") " pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:46.869628 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.869521    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkcd9\""
May 26 00:08:46.876921 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:46.876892    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:47.073267 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:47.073235    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cktzs"]
May 26 00:08:47.077118 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:08:47.077085    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d24d6c7_9212_49b0_8a14_0fa836285fcf.slice/crio-6b3f32a186cff7c0f00f1bee76c3b230d3986c94bcf550e07cd427d3cbaeeca0 WatchSource:0}: Error finding container 6b3f32a186cff7c0f00f1bee76c3b230d3986c94bcf550e07cd427d3cbaeeca0: Status 404 returned error can't find the container with id 6b3f32a186cff7c0f00f1bee76c3b230d3986c94bcf550e07cd427d3cbaeeca0
May 26 00:08:47.160250 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:47.160215    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cktzs" event={"ID":"8d24d6c7-9212-49b0-8a14-0fa836285fcf","Type":"ContainerStarted","Data":"6b3f32a186cff7c0f00f1bee76c3b230d3986c94bcf550e07cd427d3cbaeeca0"}
May 26 00:08:47.947744 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:47.947701    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:08:47.948178 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:47.947768    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:08:47.948178 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:47.947878    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:47.948178 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:47.947890    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:47.948178 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:47.947943    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert podName:a4c72b19-dbf7-4a99-825a-b915659541fc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:19.947925069 +0000 UTC m=+98.695966265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert") pod "ingress-canary-6zlq6" (UID: "a4c72b19-dbf7-4a99-825a-b915659541fc") : secret "canary-serving-cert" not found
May 26 00:08:47.948178 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:08:47.947959    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls podName:013c46bf-8592-4a5a-80da-6d88abe8b20a nodeName:}" failed. No retries permitted until 2026-05-26 00:09:19.947952382 +0000 UTC m=+98.695993578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls") pod "dns-default-4rjj5" (UID: "013c46bf-8592-4a5a-80da-6d88abe8b20a") : secret "dns-default-metrics-tls" not found
May 26 00:08:50.166152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:50.166115    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cktzs" event={"ID":"8d24d6c7-9212-49b0-8a14-0fa836285fcf","Type":"ContainerStarted","Data":"6d5c3a8c8fda60960b9b1bfce3216950d6c46878472872be71398f9982708341"}
May 26 00:08:50.166520 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:50.166242    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:08:50.181321 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:08:50.181270    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cktzs" podStartSLOduration=65.584082332 podStartE2EDuration="1m8.181255851s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:08:47.078801611 +0000 UTC m=+65.826842809" lastFinishedPulling="2026-05-26 00:08:49.675975127 +0000 UTC m=+68.424016328" observedRunningTime="2026-05-26 00:08:50.180297014 +0000 UTC m=+68.928338234" watchObservedRunningTime="2026-05-26 00:08:50.181255851 +0000 UTC m=+68.929297069"
May 26 00:09:01.101171 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.101058    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"]
May 26 00:09:01.103981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.103956    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"
May 26 00:09:01.106741 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.106711    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 00:09:01.106816 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.106755    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 00:09:01.108017 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.108000    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v6z2n\""
May 26 00:09:01.111373 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.111346    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"]
May 26 00:09:01.204702 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.204668    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"]
May 26 00:09:01.207441 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.207425    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.210242 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.210220    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 26 00:09:01.210242 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.210225    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 00:09:01.211733 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.211716    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 00:09:01.211817 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.211795    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 26 00:09:01.211882 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.211841    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-25xf9\""
May 26 00:09:01.216862 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.216841    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"]
May 26 00:09:01.237727 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.237695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tqss\" (UniqueName: \"kubernetes.io/projected/e0946040-a609-4bf4-af7c-44633ba405ab-kube-api-access-7tqss\") pod \"volume-data-source-validator-5cf8c89d64-mf7c2\" (UID: \"e0946040-a609-4bf4-af7c-44633ba405ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"
May 26 00:09:01.309078 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.309044    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"]
May 26 00:09:01.311816 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.311797    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.314556 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.314540    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 00:09:01.314898 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.314881    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 00:09:01.314967 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.314881    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 00:09:01.315015 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.314960    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gv8x9\""
May 26 00:09:01.321579 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.321558    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"]
May 26 00:09:01.338337 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.338309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4dceeebf-1f0d-48a1-86b2-60425b634abc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.338459 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.338341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.338459 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.338373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rx6\" (UniqueName: \"kubernetes.io/projected/4dceeebf-1f0d-48a1-86b2-60425b634abc-kube-api-access-d9rx6\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.338459 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.338421    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tqss\" (UniqueName: \"kubernetes.io/projected/e0946040-a609-4bf4-af7c-44633ba405ab-kube-api-access-7tqss\") pod \"volume-data-source-validator-5cf8c89d64-mf7c2\" (UID: \"e0946040-a609-4bf4-af7c-44633ba405ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"
May 26 00:09:01.368069 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.368003    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tqss\" (UniqueName: \"kubernetes.io/projected/e0946040-a609-4bf4-af7c-44633ba405ab-kube-api-access-7tqss\") pod \"volume-data-source-validator-5cf8c89d64-mf7c2\" (UID: \"e0946040-a609-4bf4-af7c-44633ba405ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"
May 26 00:09:01.412897 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.412863    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.439943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.440010    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4dceeebf-1f0d-48a1-86b2-60425b634abc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.440039    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.440070    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rx6\" (UniqueName: \"kubernetes.io/projected/4dceeebf-1f0d-48a1-86b2-60425b634abc-kube-api-access-d9rx6\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.440117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx8mz\" (UniqueName: \"kubernetes.io/projected/1816a094-6864-43a4-89cd-c9e486fa21d2-kube-api-access-wx8mz\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.441000    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4dceeebf-1f0d-48a1-86b2-60425b634abc-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.441115    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:01.447368 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.441174    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:01.941154692 +0000 UTC m=+80.689195896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:01.450458 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.450385    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rx6\" (UniqueName: \"kubernetes.io/projected/4dceeebf-1f0d-48a1-86b2-60425b634abc-kube-api-access-d9rx6\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.541242 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.541201    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.541396 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.541285    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx8mz\" (UniqueName: \"kubernetes.io/projected/1816a094-6864-43a4-89cd-c9e486fa21d2-kube-api-access-wx8mz\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.541396 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.541347    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 00:09:01.541468 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.541419    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls podName:1816a094-6864-43a4-89cd-c9e486fa21d2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:02.041400298 +0000 UTC m=+80.789441495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls") pod "cluster-samples-operator-697587599-pdpv5" (UID: "1816a094-6864-43a4-89cd-c9e486fa21d2") : secret "samples-operator-tls" not found
May 26 00:09:01.545776 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.545750    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2"]
May 26 00:09:01.549083 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:01.549052    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0946040_a609_4bf4_af7c_44633ba405ab.slice/crio-05fdbe8f1ab3094be9a9df452f91a19fda02400eb5e5e915ddf4366803da0e0d WatchSource:0}: Error finding container 05fdbe8f1ab3094be9a9df452f91a19fda02400eb5e5e915ddf4366803da0e0d: Status 404 returned error can't find the container with id 05fdbe8f1ab3094be9a9df452f91a19fda02400eb5e5e915ddf4366803da0e0d
May 26 00:09:01.552719 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.552682    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx8mz\" (UniqueName: \"kubernetes.io/projected/1816a094-6864-43a4-89cd-c9e486fa21d2-kube-api-access-wx8mz\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:01.945402 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:01.945361    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:01.945653 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.945508    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:01.945653 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:01.945575    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:02.945560027 +0000 UTC m=+81.693601229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:02.045866 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:02.045831    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:02.046040 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:02.045975    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 00:09:02.046040 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:02.046036    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls podName:1816a094-6864-43a4-89cd-c9e486fa21d2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:03.046021349 +0000 UTC m=+81.794062546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls") pod "cluster-samples-operator-697587599-pdpv5" (UID: "1816a094-6864-43a4-89cd-c9e486fa21d2") : secret "samples-operator-tls" not found
May 26 00:09:02.189469 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:02.189431    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2" event={"ID":"e0946040-a609-4bf4-af7c-44633ba405ab","Type":"ContainerStarted","Data":"05fdbe8f1ab3094be9a9df452f91a19fda02400eb5e5e915ddf4366803da0e0d"}
May 26 00:09:02.953228 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:02.953188    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:02.953407 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:02.953340    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:02.953446 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:02.953426    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:04.953408378 +0000 UTC m=+83.701449581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:03.054259 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.054217    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:03.054549 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:03.054424    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 00:09:03.054549 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:03.054495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls podName:1816a094-6864-43a4-89cd-c9e486fa21d2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:05.05447426 +0000 UTC m=+83.802515481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls") pod "cluster-samples-operator-697587599-pdpv5" (UID: "1816a094-6864-43a4-89cd-c9e486fa21d2") : secret "samples-operator-tls" not found
May 26 00:09:03.130262 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.130226    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"]
May 26 00:09:03.133148 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.133129    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.135970 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.135951    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 26 00:09:03.137300 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.137279    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 26 00:09:03.137392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.137329    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 26 00:09:03.137392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.137289    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tmgcq\""
May 26 00:09:03.137499 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.137329    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 26 00:09:03.143654 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.143632    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"]
May 26 00:09:03.154772 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.154746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c40378ac-aae1-4652-a23f-7271dc560aad-config\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.154883 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.154857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c40378ac-aae1-4652-a23f-7271dc560aad-serving-cert\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.154944 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.154912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b7zp\" (UniqueName: \"kubernetes.io/projected/c40378ac-aae1-4652-a23f-7271dc560aad-kube-api-access-9b7zp\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.192781 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.192749    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2" event={"ID":"e0946040-a609-4bf4-af7c-44633ba405ab","Type":"ContainerStarted","Data":"48edcbe4ab6fd1beb15e6160db1d7fe2eeec9766af96df9622490bab58e6c711"}
May 26 00:09:03.207216 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.207084    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mf7c2" podStartSLOduration=0.623770668 podStartE2EDuration="2.207066371s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:01.551106612 +0000 UTC m=+80.299147816" lastFinishedPulling="2026-05-26 00:09:03.134402322 +0000 UTC m=+81.882443519" observedRunningTime="2026-05-26 00:09:03.206553962 +0000 UTC m=+81.954595182" watchObservedRunningTime="2026-05-26 00:09:03.207066371 +0000 UTC m=+81.955107590"
May 26 00:09:03.255223 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.255183    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c40378ac-aae1-4652-a23f-7271dc560aad-serving-cert\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.255223 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.255224    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9b7zp\" (UniqueName: \"kubernetes.io/projected/c40378ac-aae1-4652-a23f-7271dc560aad-kube-api-access-9b7zp\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.255583 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.255560    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c40378ac-aae1-4652-a23f-7271dc560aad-config\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.256089 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.256055    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c40378ac-aae1-4652-a23f-7271dc560aad-config\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.257562 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.257543    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c40378ac-aae1-4652-a23f-7271dc560aad-serving-cert\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.263347 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.263321    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b7zp\" (UniqueName: \"kubernetes.io/projected/c40378ac-aae1-4652-a23f-7271dc560aad-kube-api-access-9b7zp\") pod \"service-ca-operator-57b5b68b8-sbhd2\" (UID: \"c40378ac-aae1-4652-a23f-7271dc560aad\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.443559 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.443514    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"
May 26 00:09:03.560730 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:03.560696    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2"]
May 26 00:09:03.563980 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:03.563947    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40378ac_aae1_4652_a23f_7271dc560aad.slice/crio-073490d37bddab24a083ba418488f814e221d438b3d63f4501b942c2f6f0a879 WatchSource:0}: Error finding container 073490d37bddab24a083ba418488f814e221d438b3d63f4501b942c2f6f0a879: Status 404 returned error can't find the container with id 073490d37bddab24a083ba418488f814e221d438b3d63f4501b942c2f6f0a879
May 26 00:09:04.196143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:04.196102    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2" event={"ID":"c40378ac-aae1-4652-a23f-7271dc560aad","Type":"ContainerStarted","Data":"073490d37bddab24a083ba418488f814e221d438b3d63f4501b942c2f6f0a879"}
May 26 00:09:04.968142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:04.968102    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:04.968310 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:04.968233    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:04.968310 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:04.968303    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:08.968286568 +0000 UTC m=+87.716327765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:05.068740 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.068694    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:05.068918 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:05.068837    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 00:09:05.068918 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:05.068906    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls podName:1816a094-6864-43a4-89cd-c9e486fa21d2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:09.06888952 +0000 UTC m=+87.816930718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls") pod "cluster-samples-operator-697587599-pdpv5" (UID: "1816a094-6864-43a4-89cd-c9e486fa21d2") : secret "samples-operator-tls" not found
May 26 00:09:05.748480 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.748304    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"]
May 26 00:09:05.751886 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.751852    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"
May 26 00:09:05.754532 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.754503    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 26 00:09:05.754690 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.754548    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rxmfn\""
May 26 00:09:05.755739 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.755721    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 26 00:09:05.759963 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.759935    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"]
May 26 00:09:05.773132 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.773010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h7ll\" (UniqueName: \"kubernetes.io/projected/821c70fd-0ac7-47b7-ad3a-0299f8fab55e-kube-api-access-9h7ll\") pod \"migrator-b985f5d89-js7b9\" (UID: \"821c70fd-0ac7-47b7-ad3a-0299f8fab55e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"
May 26 00:09:05.873454 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.873428    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h7ll\" (UniqueName: \"kubernetes.io/projected/821c70fd-0ac7-47b7-ad3a-0299f8fab55e-kube-api-access-9h7ll\") pod \"migrator-b985f5d89-js7b9\" (UID: \"821c70fd-0ac7-47b7-ad3a-0299f8fab55e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"
May 26 00:09:05.881376 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:05.881351    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h7ll\" (UniqueName: \"kubernetes.io/projected/821c70fd-0ac7-47b7-ad3a-0299f8fab55e-kube-api-access-9h7ll\") pod \"migrator-b985f5d89-js7b9\" (UID: \"821c70fd-0ac7-47b7-ad3a-0299f8fab55e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"
May 26 00:09:06.064014 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:06.063918    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"
May 26 00:09:06.183183 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:06.183153    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9"]
May 26 00:09:06.186720 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:06.186691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821c70fd_0ac7_47b7_ad3a_0299f8fab55e.slice/crio-cbb644e3aefb794f72e1bf0812188ffebe9faa192e2fe94266dee111df1431fa WatchSource:0}: Error finding container cbb644e3aefb794f72e1bf0812188ffebe9faa192e2fe94266dee111df1431fa: Status 404 returned error can't find the container with id cbb644e3aefb794f72e1bf0812188ffebe9faa192e2fe94266dee111df1431fa
May 26 00:09:06.201359 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:06.201331    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2" event={"ID":"c40378ac-aae1-4652-a23f-7271dc560aad","Type":"ContainerStarted","Data":"a5d54f4e6ee316e408b8d1350838ece326c1691f4601af23e7f34375c653a6b9"}
May 26 00:09:06.202383 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:06.202360    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9" event={"ID":"821c70fd-0ac7-47b7-ad3a-0299f8fab55e","Type":"ContainerStarted","Data":"cbb644e3aefb794f72e1bf0812188ffebe9faa192e2fe94266dee111df1431fa"}
May 26 00:09:06.220659 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:06.220610    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2" podStartSLOduration=0.945638545 podStartE2EDuration="3.22058322s" podCreationTimestamp="2026-05-26 00:09:03 +0000 UTC" firstStartedPulling="2026-05-26 00:09:03.565794212 +0000 UTC m=+82.313835414" lastFinishedPulling="2026-05-26 00:09:05.840738892 +0000 UTC m=+84.588780089" observedRunningTime="2026-05-26 00:09:06.219535495 +0000 UTC m=+84.967576726" watchObservedRunningTime="2026-05-26 00:09:06.22058322 +0000 UTC m=+84.968624481"
May 26 00:09:08.208199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:08.208160    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9" event={"ID":"821c70fd-0ac7-47b7-ad3a-0299f8fab55e","Type":"ContainerStarted","Data":"e2a32a8116455d992f4b02af787be3d8ee5f0a46b209f0d62998e8d41b9be9ae"}
May 26 00:09:08.208199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:08.208204    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9" event={"ID":"821c70fd-0ac7-47b7-ad3a-0299f8fab55e","Type":"ContainerStarted","Data":"ea4030572a9b13f0250e43fd766dcdade5f86ba7617761b6c250eeb83ef0b195"}
May 26 00:09:08.686263 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:08.686233    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dqrng_354a28fe-146a-49ac-93a3-a43ac8603acb/dns-node-resolver/0.log"
May 26 00:09:08.993972 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:08.993875    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:08.994181 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:08.994038    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:08.994181 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:08.994109    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:16.994092495 +0000 UTC m=+95.742133692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:09.095233 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:09.095200    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:09.095387 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:09.095354    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 00:09:09.095426 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:09.095413    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls podName:1816a094-6864-43a4-89cd-c9e486fa21d2 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:17.095397117 +0000 UTC m=+95.843438314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls") pod "cluster-samples-operator-697587599-pdpv5" (UID: "1816a094-6864-43a4-89cd-c9e486fa21d2") : secret "samples-operator-tls" not found
May 26 00:09:09.685848 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:09.685819    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z65cf_816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9/node-ca/0.log"
May 26 00:09:10.686079 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:10.686052    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-js7b9_821c70fd-0ac7-47b7-ad3a-0299f8fab55e/migrator/0.log"
May 26 00:09:10.886258 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:10.886230    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-js7b9_821c70fd-0ac7-47b7-ad3a-0299f8fab55e/graceful-termination/0.log"
May 26 00:09:17.053496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.053453    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:17.053995 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:17.053636    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 00:09:17.053995 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:17.053735    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls podName:4dceeebf-1f0d-48a1-86b2-60425b634abc nodeName:}" failed. No retries permitted until 2026-05-26 00:09:33.053714383 +0000 UTC m=+111.801755581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-8gb7w" (UID: "4dceeebf-1f0d-48a1-86b2-60425b634abc") : secret "cluster-monitoring-operator-tls" not found
May 26 00:09:17.154127 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.154087    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:17.156506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.156480    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1816a094-6864-43a4-89cd-c9e486fa21d2-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pdpv5\" (UID: \"1816a094-6864-43a4-89cd-c9e486fa21d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:17.220711 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.220658    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"
May 26 00:09:17.342714 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.342580    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-js7b9" podStartSLOduration=11.021993553 podStartE2EDuration="12.342563564s" podCreationTimestamp="2026-05-26 00:09:05 +0000 UTC" firstStartedPulling="2026-05-26 00:09:06.188641861 +0000 UTC m=+84.936683058" lastFinishedPulling="2026-05-26 00:09:07.509211868 +0000 UTC m=+86.257253069" observedRunningTime="2026-05-26 00:09:08.222423672 +0000 UTC m=+86.970464891" watchObservedRunningTime="2026-05-26 00:09:17.342563564 +0000 UTC m=+96.090604823"
May 26 00:09:17.343330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:17.343314    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5"]
May 26 00:09:18.228350 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:18.228307    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5" event={"ID":"1816a094-6864-43a4-89cd-c9e486fa21d2","Type":"ContainerStarted","Data":"39064830318a0c15930ebc8b1567964095cb35391b94f88adc26f30a66a87b1a"}
May 26 00:09:19.976034 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:19.975993    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:09:19.976562 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:19.976057    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:09:19.978454 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:19.978426    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/013c46bf-8592-4a5a-80da-6d88abe8b20a-metrics-tls\") pod \"dns-default-4rjj5\" (UID: \"013c46bf-8592-4a5a-80da-6d88abe8b20a\") " pod="openshift-dns/dns-default-4rjj5"
May 26 00:09:19.978554 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:19.978461    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4c72b19-dbf7-4a99-825a-b915659541fc-cert\") pod \"ingress-canary-6zlq6\" (UID: \"a4c72b19-dbf7-4a99-825a-b915659541fc\") " pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:09:20.002952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.002919    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ln8c\""
May 26 00:09:20.011267 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.011244    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4rjj5"
May 26 00:09:20.020273 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.020252    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vc6m6\""
May 26 00:09:20.028404 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.028385    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zlq6"
May 26 00:09:20.142325 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.142289    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4rjj5"]
May 26 00:09:20.145280 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:20.145252    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013c46bf_8592_4a5a_80da_6d88abe8b20a.slice/crio-7be982b69ca79db2e28ac348a2f98ab50d437be3c04c67d3ef8ce66fc8fe045f WatchSource:0}: Error finding container 7be982b69ca79db2e28ac348a2f98ab50d437be3c04c67d3ef8ce66fc8fe045f: Status 404 returned error can't find the container with id 7be982b69ca79db2e28ac348a2f98ab50d437be3c04c67d3ef8ce66fc8fe045f
May 26 00:09:20.156654 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.156629    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zlq6"]
May 26 00:09:20.159447 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:20.159421    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c72b19_dbf7_4a99_825a_b915659541fc.slice/crio-91ad85f072130496b1b9bfa06890593de9da9a6430206f71108303f59924156f WatchSource:0}: Error finding container 91ad85f072130496b1b9bfa06890593de9da9a6430206f71108303f59924156f: Status 404 returned error can't find the container with id 91ad85f072130496b1b9bfa06890593de9da9a6430206f71108303f59924156f
May 26 00:09:20.236754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.236657    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5" event={"ID":"1816a094-6864-43a4-89cd-c9e486fa21d2","Type":"ContainerStarted","Data":"1a3e3f9d2c14e5d8d5dc1e5030486e49e51613a2f5fe4e31ad46e9c1b95bb807"}
May 26 00:09:20.236754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.236698    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5" event={"ID":"1816a094-6864-43a4-89cd-c9e486fa21d2","Type":"ContainerStarted","Data":"a5ccd340ada914bc16c2a27bc35a15c83854682ae7d3a36f9a65c365ff810603"}
May 26 00:09:20.237658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.237634    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rjj5" event={"ID":"013c46bf-8592-4a5a-80da-6d88abe8b20a","Type":"ContainerStarted","Data":"7be982b69ca79db2e28ac348a2f98ab50d437be3c04c67d3ef8ce66fc8fe045f"}
May 26 00:09:20.238483 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.238463    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zlq6" event={"ID":"a4c72b19-dbf7-4a99-825a-b915659541fc","Type":"ContainerStarted","Data":"91ad85f072130496b1b9bfa06890593de9da9a6430206f71108303f59924156f"}
May 26 00:09:20.252255 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:20.252206    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pdpv5" podStartSLOduration=17.263609249 podStartE2EDuration="19.252193285s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:17.385113544 +0000 UTC m=+96.133154754" lastFinishedPulling="2026-05-26 00:09:19.373697591 +0000 UTC m=+98.121738790" observedRunningTime="2026-05-26 00:09:20.251081565 +0000 UTC m=+98.999122789" watchObservedRunningTime="2026-05-26 00:09:20.252193285 +0000 UTC m=+99.000234502"
May 26 00:09:21.170762 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:21.170729    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cktzs"
May 26 00:09:22.247123 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.247081    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rjj5" event={"ID":"013c46bf-8592-4a5a-80da-6d88abe8b20a","Type":"ContainerStarted","Data":"a6f8d8422f32bfee9242d964818a9c431855aa2aed44db8c3f620e8d4ac4d394"}
May 26 00:09:22.247123 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.247128    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4rjj5" event={"ID":"013c46bf-8592-4a5a-80da-6d88abe8b20a","Type":"ContainerStarted","Data":"ae338cb386308f4bea7b8bab738e017e700d5a3456c49ee1b0afe8ba1d02f185"}
May 26 00:09:22.247687 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.247242    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4rjj5"
May 26 00:09:22.248438 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.248408    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zlq6" event={"ID":"a4c72b19-dbf7-4a99-825a-b915659541fc","Type":"ContainerStarted","Data":"36b5240da19c72de581d2ccf6f35a4b805d8a3484d9dd03e4bdc1b64cf9828e1"}
May 26 00:09:22.264904 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.264859    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4rjj5" podStartSLOduration=64.373829388 podStartE2EDuration="1m6.264843126s" podCreationTimestamp="2026-05-26 00:08:16 +0000 UTC" firstStartedPulling="2026-05-26 00:09:20.147033381 +0000 UTC m=+98.895074582" lastFinishedPulling="2026-05-26 00:09:22.038047108 +0000 UTC m=+100.786088320" observedRunningTime="2026-05-26 00:09:22.264254228 +0000 UTC m=+101.012295447" watchObservedRunningTime="2026-05-26 00:09:22.264843126 +0000 UTC m=+101.012884353"
May 26 00:09:22.278392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:22.278347    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6zlq6" podStartSLOduration=64.398403618 podStartE2EDuration="1m6.278331923s" podCreationTimestamp="2026-05-26 00:08:16 +0000 UTC" firstStartedPulling="2026-05-26 00:09:20.161376102 +0000 UTC m=+98.909417299" lastFinishedPulling="2026-05-26 00:09:22.041304403 +0000 UTC m=+100.789345604" observedRunningTime="2026-05-26 00:09:22.277995486 +0000 UTC m=+101.026036704" watchObservedRunningTime="2026-05-26 00:09:22.278331923 +0000 UTC m=+101.026373143"
May 26 00:09:30.617301 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.617266    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5778cb6655-7sj74"]
May 26 00:09:30.620322 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.620298    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.622872 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.622846    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 00:09:30.623359 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.623341    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 00:09:30.624280 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.624261    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w26pg\""
May 26 00:09:30.624374 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.624306    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 00:09:30.628792 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.628765    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 00:09:30.632789 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.632768    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5778cb6655-7sj74"]
May 26 00:09:30.642616 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.642579    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rhdnf"]
May 26 00:09:30.645588 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.645569    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.648530 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.648511    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 00:09:30.648660 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.648511    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 00:09:30.648965 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.648950    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 00:09:30.649080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.649066    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 00:09:30.649588 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.649573    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v5x2q\""
May 26 00:09:30.656836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.656815    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rhdnf"]
May 26 00:09:30.660103 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd4p\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660221 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660221 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660221 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660221 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660406 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660406 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.660406 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.660263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.700767 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.700722    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5778cb6655-7sj74"]
May 26 00:09:30.700947 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:30.700909    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-brd4p registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5778cb6655-7sj74" podUID="13bac319-a1bf-4579-b8bd-8500ce711f3a"
May 26 00:09:30.761231 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761189    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brd4p\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761397 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-crio-socket\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.761397 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.761397 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761352    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761397 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761386    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761592 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761408    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761592 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761423    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761592 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761443    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761592 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761470    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vxp\" (UniqueName: \"kubernetes.io/projected/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-api-access-t9vxp\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.761807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761744    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.761807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-data-volume\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.761960 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.761960 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.761888    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.762540 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.762511    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.762699 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.762519    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.764157 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.764136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.764258 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.764234    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.764293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.764267    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.781006 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.780978    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.781110 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.781041    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd4p\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p\") pod \"image-registry-5778cb6655-7sj74\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") " pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:30.862557 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862518    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-data-volume\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.862557 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862566    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.862810 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862653    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-crio-socket\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.862810 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862677    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.862810 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862742    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vxp\" (UniqueName: \"kubernetes.io/projected/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-api-access-t9vxp\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.862810 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862769    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-crio-socket\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.863018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.862911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-data-volume\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.863217 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.863198    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.865335 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.865317    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.871921 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.871861    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vxp\" (UniqueName: \"kubernetes.io/projected/eb63beaf-2737-48bd-8968-0a11a4e6d0fe-kube-api-access-t9vxp\") pod \"insights-runtime-extractor-rhdnf\" (UID: \"eb63beaf-2737-48bd-8968-0a11a4e6d0fe\") " pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:30.954626 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:30.954568    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rhdnf"
May 26 00:09:31.075175 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.075140    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rhdnf"]
May 26 00:09:31.077970 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:31.077946    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb63beaf_2737_48bd_8968_0a11a4e6d0fe.slice/crio-f38abf18bf7b7541b46e77ea42dfa68717f691bc4c36f236bce4e999b55038a8 WatchSource:0}: Error finding container f38abf18bf7b7541b46e77ea42dfa68717f691bc4c36f236bce4e999b55038a8: Status 404 returned error can't find the container with id f38abf18bf7b7541b46e77ea42dfa68717f691bc4c36f236bce4e999b55038a8
May 26 00:09:31.272893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.272864    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:31.273035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.272859    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhdnf" event={"ID":"eb63beaf-2737-48bd-8968-0a11a4e6d0fe","Type":"ContainerStarted","Data":"aed16f3d74d3822dde6f4945bf1ac855b04e0ab065873826e8fad53cef69d6af"}
May 26 00:09:31.273035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.272982    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhdnf" event={"ID":"eb63beaf-2737-48bd-8968-0a11a4e6d0fe","Type":"ContainerStarted","Data":"f38abf18bf7b7541b46e77ea42dfa68717f691bc4c36f236bce4e999b55038a8"}
May 26 00:09:31.276949 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.276927    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:31.367799 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.367751    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.367925 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.367827    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brd4p\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.367925 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.367853    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368003 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.367939    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368003 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.367981    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368009    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368052    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368179 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368079    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca\") pod \"13bac319-a1bf-4579-b8bd-8500ce711f3a\" (UID: \"13bac319-a1bf-4579-b8bd-8500ce711f3a\") "
May 26 00:09:31.368269 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368244    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:09:31.368358 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368336    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:09:31.368421 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368408    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13bac319-a1bf-4579-b8bd-8500ce711f3a-ca-trust-extracted\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.368555 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.368539    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:09:31.370165 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.370134    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:09:31.370265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.370162    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:09:31.370265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.370158    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:09:31.370404 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.370386    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:09:31.370463 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.370444    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p" (OuterVolumeSpecName: "kube-api-access-brd4p") pod "13bac319-a1bf-4579-b8bd-8500ce711f3a" (UID: "13bac319-a1bf-4579-b8bd-8500ce711f3a"). InnerVolumeSpecName "kube-api-access-brd4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:09:31.468993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.468962    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-image-registry-private-configuration\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.468993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.468990    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-trusted-ca\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.468993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.469000    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13bac319-a1bf-4579-b8bd-8500ce711f3a-installation-pull-secrets\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.469224 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.469011    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brd4p\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-kube-api-access-brd4p\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.469224 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.469021    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-bound-sa-token\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.469224 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.469030    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-certificates\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:31.469224 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:31.469039    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13bac319-a1bf-4579-b8bd-8500ce711f3a-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:09:32.252446 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:32.252412    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4rjj5"
May 26 00:09:32.277570 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:32.277541    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5778cb6655-7sj74"
May 26 00:09:32.277570 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:32.277556    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhdnf" event={"ID":"eb63beaf-2737-48bd-8968-0a11a4e6d0fe","Type":"ContainerStarted","Data":"14d683e0097be2aaa16917227ff463bd4e6b5de18f0c695e594112cf000d9173"}
May 26 00:09:32.305912 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:32.305879    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5778cb6655-7sj74"]
May 26 00:09:32.308826 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:32.308795    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5778cb6655-7sj74"]
May 26 00:09:33.082930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:33.082888    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:33.085920 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:33.085885    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4dceeebf-1f0d-48a1-86b2-60425b634abc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-8gb7w\" (UID: \"4dceeebf-1f0d-48a1-86b2-60425b634abc\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:33.315593 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:33.315549    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"
May 26 00:09:33.664492 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:33.664463    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w"]
May 26 00:09:33.667458 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:33.667431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dceeebf_1f0d_48a1_86b2_60425b634abc.slice/crio-7bbe65477d2dcda040172af2146f4ca83679cf7e23ad03e3307c425d9ed9fa73 WatchSource:0}: Error finding container 7bbe65477d2dcda040172af2146f4ca83679cf7e23ad03e3307c425d9ed9fa73: Status 404 returned error can't find the container with id 7bbe65477d2dcda040172af2146f4ca83679cf7e23ad03e3307c425d9ed9fa73
May 26 00:09:33.861130 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:33.860983    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13bac319-a1bf-4579-b8bd-8500ce711f3a" path="/var/lib/kubelet/pods/13bac319-a1bf-4579-b8bd-8500ce711f3a/volumes"
May 26 00:09:34.286865 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:34.286831    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w" event={"ID":"4dceeebf-1f0d-48a1-86b2-60425b634abc","Type":"ContainerStarted","Data":"7bbe65477d2dcda040172af2146f4ca83679cf7e23ad03e3307c425d9ed9fa73"}
May 26 00:09:34.288778 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:34.288748    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rhdnf" event={"ID":"eb63beaf-2737-48bd-8968-0a11a4e6d0fe","Type":"ContainerStarted","Data":"e589581032a43de9e1b9eab1b2a496879dea96f6da951546c49f53f57d85d425"}
May 26 00:09:34.305682 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:34.305623    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rhdnf" podStartSLOduration=1.8475093930000002 podStartE2EDuration="4.305588421s" podCreationTimestamp="2026-05-26 00:09:30 +0000 UTC" firstStartedPulling="2026-05-26 00:09:31.130724786 +0000 UTC m=+109.878765986" lastFinishedPulling="2026-05-26 00:09:33.588803809 +0000 UTC m=+112.336845014" observedRunningTime="2026-05-26 00:09:34.30509627 +0000 UTC m=+113.053137490" watchObservedRunningTime="2026-05-26 00:09:34.305588421 +0000 UTC m=+113.053629639"
May 26 00:09:36.200362 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.200322    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"]
May 26 00:09:36.203293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.203276    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:36.205781 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.205758    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 00:09:36.205932 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.205758    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s2d8k\""
May 26 00:09:36.210331 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.210307    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"]
May 26 00:09:36.295657 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.295616    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w" event={"ID":"4dceeebf-1f0d-48a1-86b2-60425b634abc","Type":"ContainerStarted","Data":"4f4d612009952ff2dcf2a701d15caef0f801b114400243b7b33a7b651bd5cfd4"}
May 26 00:09:36.309565 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.309530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn\" (UID: \"ed615e9e-f1bc-4644-9397-408051fbf224\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:36.311129 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.311088    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-8gb7w" podStartSLOduration=33.251167524 podStartE2EDuration="35.311075988s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:33.669263457 +0000 UTC m=+112.417304669" lastFinishedPulling="2026-05-26 00:09:35.729171923 +0000 UTC m=+114.477213133" observedRunningTime="2026-05-26 00:09:36.310743629 +0000 UTC m=+115.058784848" watchObservedRunningTime="2026-05-26 00:09:36.311075988 +0000 UTC m=+115.059117206"
May 26 00:09:36.410262 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.410219    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn\" (UID: \"ed615e9e-f1bc-4644-9397-408051fbf224\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:36.410472 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:36.410400    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 26 00:09:36.410543 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:36.410484    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates podName:ed615e9e-f1bc-4644-9397-408051fbf224 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:36.910464064 +0000 UTC m=+115.658505275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn" (UID: "ed615e9e-f1bc-4644-9397-408051fbf224") : secret "prometheus-operator-admission-webhook-tls" not found
May 26 00:09:36.914312 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.914270    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn\" (UID: \"ed615e9e-f1bc-4644-9397-408051fbf224\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:36.916752 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:36.916730    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed615e9e-f1bc-4644-9397-408051fbf224-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn\" (UID: \"ed615e9e-f1bc-4644-9397-408051fbf224\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:37.112346 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:37.112301    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:37.251653 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:37.251619    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"]
May 26 00:09:37.254948 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:37.254900    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded615e9e_f1bc_4644_9397_408051fbf224.slice/crio-7b0f5454dcb2ad593513f132f58aaeed0a1486b7b74e1ad988d01ca6c4379109 WatchSource:0}: Error finding container 7b0f5454dcb2ad593513f132f58aaeed0a1486b7b74e1ad988d01ca6c4379109: Status 404 returned error can't find the container with id 7b0f5454dcb2ad593513f132f58aaeed0a1486b7b74e1ad988d01ca6c4379109
May 26 00:09:37.299051 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:37.299017    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn" event={"ID":"ed615e9e-f1bc-4644-9397-408051fbf224","Type":"ContainerStarted","Data":"7b0f5454dcb2ad593513f132f58aaeed0a1486b7b74e1ad988d01ca6c4379109"}
May 26 00:09:39.305627 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:39.305578    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn" event={"ID":"ed615e9e-f1bc-4644-9397-408051fbf224","Type":"ContainerStarted","Data":"93eda39d627c50760911b472cc42e8415e376da5d60985d008bfcad72eb044bf"}
May 26 00:09:39.306017 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:39.305796    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:39.311147 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:39.311120    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn"
May 26 00:09:39.320322 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:39.320278    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn" podStartSLOduration=2.262692726 podStartE2EDuration="3.320266065s" podCreationTimestamp="2026-05-26 00:09:36 +0000 UTC" firstStartedPulling="2026-05-26 00:09:37.25689555 +0000 UTC m=+116.004936750" lastFinishedPulling="2026-05-26 00:09:38.314468889 +0000 UTC m=+117.062510089" observedRunningTime="2026-05-26 00:09:39.320236096 +0000 UTC m=+118.068277318" watchObservedRunningTime="2026-05-26 00:09:39.320266065 +0000 UTC m=+118.068307283"
May 26 00:09:40.258886 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.258843    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"]
May 26 00:09:40.262209 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.262184    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.264807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.264787    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 26 00:09:40.266130 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.266108    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 00:09:40.266250 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.266166    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 26 00:09:40.266250 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.266202    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bbqx4\""
May 26 00:09:40.269235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.269212    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"]
May 26 00:09:40.337235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.337196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.337661 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.337247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.337661 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.337301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlnbr\" (UniqueName: \"kubernetes.io/projected/334e0fc2-8773-44fa-8c91-21f991e134f1-kube-api-access-xlnbr\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.337661 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.337363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/334e0fc2-8773-44fa-8c91-21f991e134f1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.438548 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.438504    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.438548 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.438543    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlnbr\" (UniqueName: \"kubernetes.io/projected/334e0fc2-8773-44fa-8c91-21f991e134f1-kube-api-access-xlnbr\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.438782 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.438566    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/334e0fc2-8773-44fa-8c91-21f991e134f1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.438782 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.438750    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.439269 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.439244    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/334e0fc2-8773-44fa-8c91-21f991e134f1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.441026 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.441004    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.441130 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.441001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/334e0fc2-8773-44fa-8c91-21f991e134f1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.446304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.446281    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlnbr\" (UniqueName: \"kubernetes.io/projected/334e0fc2-8773-44fa-8c91-21f991e134f1-kube-api-access-xlnbr\") pod \"prometheus-operator-7779bbdd78-8zmr6\" (UID: \"334e0fc2-8773-44fa-8c91-21f991e134f1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.571344 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.571254    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"
May 26 00:09:40.691292 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:40.691241    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6"]
May 26 00:09:40.695727 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:40.695695    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334e0fc2_8773_44fa_8c91_21f991e134f1.slice/crio-1601b19cc87105a1c2d9d86f91d80c49030fb575c755c8ab3e4819dc5bdb7b94 WatchSource:0}: Error finding container 1601b19cc87105a1c2d9d86f91d80c49030fb575c755c8ab3e4819dc5bdb7b94: Status 404 returned error can't find the container with id 1601b19cc87105a1c2d9d86f91d80c49030fb575c755c8ab3e4819dc5bdb7b94
May 26 00:09:41.311778 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:41.311742    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6" event={"ID":"334e0fc2-8773-44fa-8c91-21f991e134f1","Type":"ContainerStarted","Data":"1601b19cc87105a1c2d9d86f91d80c49030fb575c755c8ab3e4819dc5bdb7b94"}
May 26 00:09:42.315570 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:42.315476    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6" event={"ID":"334e0fc2-8773-44fa-8c91-21f991e134f1","Type":"ContainerStarted","Data":"3d15b67809a5b2d0038902ff606ba0fa9eb34e793995a35f42bbbe72bc2513b7"}
May 26 00:09:42.315570 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:42.315520    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6" event={"ID":"334e0fc2-8773-44fa-8c91-21f991e134f1","Type":"ContainerStarted","Data":"2abc37e9a66c32a772f6b7eee0303f4659be6c23bfa333b571197a46864db3bc"}
May 26 00:09:42.332185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:42.332106    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-8zmr6" podStartSLOduration=0.99647275 podStartE2EDuration="2.332092703s" podCreationTimestamp="2026-05-26 00:09:40 +0000 UTC" firstStartedPulling="2026-05-26 00:09:40.697540783 +0000 UTC m=+119.445581997" lastFinishedPulling="2026-05-26 00:09:42.03316075 +0000 UTC m=+120.781201950" observedRunningTime="2026-05-26 00:09:42.331152087 +0000 UTC m=+121.079193305" watchObservedRunningTime="2026-05-26 00:09:42.332092703 +0000 UTC m=+121.080133922"
May 26 00:09:44.560026 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.559992    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"]
May 26 00:09:44.563212 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.563193    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.565854 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.565828    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 00:09:44.565978 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.565851    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hm9lc\""
May 26 00:09:44.565978 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.565832    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 00:09:44.573778 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.573755    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"]
May 26 00:09:44.583473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.583451    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"]
May 26 00:09:44.586525 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.586504    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9hk2t"]
May 26 00:09:44.586691 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.586674    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.589409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.589391    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.589778 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.589755    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 00:09:44.589876 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.589849    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 00:09:44.589930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.589903    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 00:09:44.590147 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.590133    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n64mc\""
May 26 00:09:44.591926 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.591908    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 00:09:44.592017 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.591937    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 00:09:44.592083 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.592067    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 00:09:44.592658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.592640    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g7ggh\""
May 26 00:09:44.597336 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.597317    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"]
May 26 00:09:44.669849 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.669818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-metrics-client-ca\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.669849 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.669859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.670091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.669944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.669978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-root\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kfx\" (UniqueName: \"kubernetes.io/projected/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-api-access-z8kfx\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x984w\" (UniqueName: \"kubernetes.io/projected/fe7d6cbb-b085-47f1-9618-0d25fb05747c-kube-api-access-x984w\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55379963-6923-4568-8c4d-86724a7fe9e9-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-textfile\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-tls\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-wtmp\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.670473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.670473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-sys\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.670662 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.670486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lptx\" (UniqueName: \"kubernetes.io/projected/55379963-6923-4568-8c4d-86724a7fe9e9-kube-api-access-2lptx\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.771229 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771184    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kfx\" (UniqueName: \"kubernetes.io/projected/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-api-access-z8kfx\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.771229 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771232    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x984w\" (UniqueName: \"kubernetes.io/projected/fe7d6cbb-b085-47f1-9618-0d25fb05747c-kube-api-access-x984w\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771454 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771404    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771454 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771444    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771537 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771464    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55379963-6923-4568-8c4d-86724a7fe9e9-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.771625 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771574    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-textfile\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771682 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771655    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.771730 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771686    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-tls\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771730 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771716    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.771835 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771741    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-wtmp\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771835 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771812    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.771930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771840    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.771930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771863    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-sys\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.771930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771890    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lptx\" (UniqueName: \"kubernetes.io/projected/55379963-6923-4568-8c4d-86724a7fe9e9-kube-api-access-2lptx\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.771930 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771923    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-metrics-client-ca\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771951    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.772126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771990    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.772126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772015    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-root\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772050    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.772126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772074    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.771952    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-textfile\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772211    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55379963-6923-4568-8c4d-86724a7fe9e9-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.772399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772256    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-wtmp\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772280    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-root\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772305    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.772674 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:44.772435    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 26 00:09:44.772674 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772453    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.772674 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772481    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7d6cbb-b085-47f1-9618-0d25fb05747c-sys\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772674 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772563    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe7d6cbb-b085-47f1-9618-0d25fb05747c-metrics-client-ca\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.772674 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:09:44.772639    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls podName:55379963-6923-4568-8c4d-86724a7fe9e9 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:45.272620191 +0000 UTC m=+124.020661396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-qhrnd" (UID: "55379963-6923-4568-8c4d-86724a7fe9e9") : secret "openshift-state-metrics-tls" not found
May 26 00:09:44.772988 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.772969    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.774371 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.774347    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.774789 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.774756    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe7d6cbb-b085-47f1-9618-0d25fb05747c-node-exporter-tls\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.774914 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.774894    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.774995 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.774937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.775084 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.775063    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.779684 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.779662    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x984w\" (UniqueName: \"kubernetes.io/projected/fe7d6cbb-b085-47f1-9618-0d25fb05747c-kube-api-access-x984w\") pod \"node-exporter-9hk2t\" (UID: \"fe7d6cbb-b085-47f1-9618-0d25fb05747c\") " pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.779806 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.779785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kfx\" (UniqueName: \"kubernetes.io/projected/f895dd7a-29c4-4c4a-b896-2daf5f60b0ab-kube-api-access-z8kfx\") pod \"kube-state-metrics-54fd6bc5c4-x7pxj\" (UID: \"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.779895 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.779879    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lptx\" (UniqueName: \"kubernetes.io/projected/55379963-6923-4568-8c4d-86724a7fe9e9-kube-api-access-2lptx\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:44.898243 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.898156    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"
May 26 00:09:44.904039 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:44.904010    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hk2t"
May 26 00:09:44.915839 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:44.915797    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7d6cbb_b085_47f1_9618_0d25fb05747c.slice/crio-f0a05ce45b7bd97f7c0cdb46bc7b5638365fe6e23969818bad5769e2e6538fc3 WatchSource:0}: Error finding container f0a05ce45b7bd97f7c0cdb46bc7b5638365fe6e23969818bad5769e2e6538fc3: Status 404 returned error can't find the container with id f0a05ce45b7bd97f7c0cdb46bc7b5638365fe6e23969818bad5769e2e6538fc3
May 26 00:09:45.025560 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.025530    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj"]
May 26 00:09:45.028554 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:45.028511    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf895dd7a_29c4_4c4a_b896_2daf5f60b0ab.slice/crio-8a862af92531b39aca957ed62b96df2039bf58d4dae9695ad3c2fa9b8ab8a288 WatchSource:0}: Error finding container 8a862af92531b39aca957ed62b96df2039bf58d4dae9695ad3c2fa9b8ab8a288: Status 404 returned error can't find the container with id 8a862af92531b39aca957ed62b96df2039bf58d4dae9695ad3c2fa9b8ab8a288
May 26 00:09:45.276609 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.276568    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:45.279004 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.278983    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55379963-6923-4568-8c4d-86724a7fe9e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-qhrnd\" (UID: \"55379963-6923-4568-8c4d-86724a7fe9e9\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:45.322880 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.322843    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hk2t" event={"ID":"fe7d6cbb-b085-47f1-9618-0d25fb05747c","Type":"ContainerStarted","Data":"f0a05ce45b7bd97f7c0cdb46bc7b5638365fe6e23969818bad5769e2e6538fc3"}
May 26 00:09:45.323829 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.323802    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj" event={"ID":"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab","Type":"ContainerStarted","Data":"8a862af92531b39aca957ed62b96df2039bf58d4dae9695ad3c2fa9b8ab8a288"}
May 26 00:09:45.472135 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.472098    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"
May 26 00:09:45.633768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:45.633738    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd"]
May 26 00:09:45.835528 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:45.835447    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55379963_6923_4568_8c4d_86724a7fe9e9.slice/crio-032c3fe87e294c5bdcc1657018081536e5cf375cacf8b7b6e67af5b7caaa0150 WatchSource:0}: Error finding container 032c3fe87e294c5bdcc1657018081536e5cf375cacf8b7b6e67af5b7caaa0150: Status 404 returned error can't find the container with id 032c3fe87e294c5bdcc1657018081536e5cf375cacf8b7b6e67af5b7caaa0150
May 26 00:09:46.329045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:46.329006    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd" event={"ID":"55379963-6923-4568-8c4d-86724a7fe9e9","Type":"ContainerStarted","Data":"9fcf989ff78725bcb2f0d0f9ef50155f641d1b74de036ca3ef1cc64c5aae7856"}
May 26 00:09:46.329284 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:46.329054    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd" event={"ID":"55379963-6923-4568-8c4d-86724a7fe9e9","Type":"ContainerStarted","Data":"0c59c7fb4e242ed5e0d59ef6772b08a0d25124c963966cfad0658a8109a957ab"}
May 26 00:09:46.329284 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:46.329069    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd" event={"ID":"55379963-6923-4568-8c4d-86724a7fe9e9","Type":"ContainerStarted","Data":"032c3fe87e294c5bdcc1657018081536e5cf375cacf8b7b6e67af5b7caaa0150"}
May 26 00:09:46.330535 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:46.330509    2560 generic.go:358] "Generic (PLEG): container finished" podID="fe7d6cbb-b085-47f1-9618-0d25fb05747c" containerID="e99809adc901835f5e9ae33c49adde8fdadaf8851523c8d226979417aa206cea" exitCode=0
May 26 00:09:46.330704 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:46.330562    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hk2t" event={"ID":"fe7d6cbb-b085-47f1-9618-0d25fb05747c","Type":"ContainerDied","Data":"e99809adc901835f5e9ae33c49adde8fdadaf8851523c8d226979417aa206cea"}
May 26 00:09:47.335040 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.335003    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hk2t" event={"ID":"fe7d6cbb-b085-47f1-9618-0d25fb05747c","Type":"ContainerStarted","Data":"4aa8d0b7ccbfd2329eeaf215ddf6171195b4ef6a65651419acd7ec775ab5d1a5"}
May 26 00:09:47.335495 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.335049    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hk2t" event={"ID":"fe7d6cbb-b085-47f1-9618-0d25fb05747c","Type":"ContainerStarted","Data":"4d69c5d349e008c9bed985827c3a0357778a3efbf72cb238140213e4c2c74b9d"}
May 26 00:09:47.336770 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.336739    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj" event={"ID":"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab","Type":"ContainerStarted","Data":"d307e684ac3f786e548635f18923edaf7d5cf3ee5bb3e88c20ba27f12b1e5521"}
May 26 00:09:47.336770 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.336771    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj" event={"ID":"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab","Type":"ContainerStarted","Data":"7ccfebd9f141adbdbca58166ba9ec9a6903095adbc5fd821e239dec80cc5fe80"}
May 26 00:09:47.336903 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.336781    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj" event={"ID":"f895dd7a-29c4-4c4a-b896-2daf5f60b0ab","Type":"ContainerStarted","Data":"99dab08174c88207f7e4ca6fa6a4a57407c38a8661fb615359bb63636c721f58"}
May 26 00:09:47.354113 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.354060    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9hk2t" podStartSLOduration=2.38620228 podStartE2EDuration="3.354045887s" podCreationTimestamp="2026-05-26 00:09:44 +0000 UTC" firstStartedPulling="2026-05-26 00:09:44.917836036 +0000 UTC m=+123.665877233" lastFinishedPulling="2026-05-26 00:09:45.885679644 +0000 UTC m=+124.633720840" observedRunningTime="2026-05-26 00:09:47.354006717 +0000 UTC m=+126.102047937" watchObservedRunningTime="2026-05-26 00:09:47.354045887 +0000 UTC m=+126.102087100"
May 26 00:09:47.376931 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:47.376878    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-x7pxj" podStartSLOduration=1.733194399 podStartE2EDuration="3.376859328s" podCreationTimestamp="2026-05-26 00:09:44 +0000 UTC" firstStartedPulling="2026-05-26 00:09:45.030374908 +0000 UTC m=+123.778416106" lastFinishedPulling="2026-05-26 00:09:46.674039834 +0000 UTC m=+125.422081035" observedRunningTime="2026-05-26 00:09:47.376588127 +0000 UTC m=+126.124629353" watchObservedRunningTime="2026-05-26 00:09:47.376859328 +0000 UTC m=+126.124900549"
May 26 00:09:48.342018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.341974    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd" event={"ID":"55379963-6923-4568-8c4d-86724a7fe9e9","Type":"ContainerStarted","Data":"fd694d6a585a7ac05bef667d2cf557cf4f0e3f9583aa897dc283494f96d5eb45"}
May 26 00:09:48.360888 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.360834    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-qhrnd" podStartSLOduration=2.9742081320000002 podStartE2EDuration="4.360819565s" podCreationTimestamp="2026-05-26 00:09:44 +0000 UTC" firstStartedPulling="2026-05-26 00:09:45.989820805 +0000 UTC m=+124.737862001" lastFinishedPulling="2026-05-26 00:09:47.376432237 +0000 UTC m=+126.124473434" observedRunningTime="2026-05-26 00:09:48.359330447 +0000 UTC m=+127.107371668" watchObservedRunningTime="2026-05-26 00:09:48.360819565 +0000 UTC m=+127.108860784"
May 26 00:09:48.981091 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.981054    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86585f5fff-f8jgn"]
May 26 00:09:48.984380 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.984361    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:48.988743 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988643    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 00:09:48.988893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988742    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 26 00:09:48.988893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988745    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rsv5v\""
May 26 00:09:48.988893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988805    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 26 00:09:48.988893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988748    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 26 00:09:48.988893 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.988748    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-87f1u6vhmkmdq\""
May 26 00:09:48.993716 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:48.993692    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86585f5fff-f8jgn"]
May 26 00:09:49.112126 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-tls\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-client-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-client-certs\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nws5b\" (UniqueName: \"kubernetes.io/projected/68d71a6b-3a89-4e6b-9803-6085967a815f-kube-api-access-nws5b\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112427 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112427 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d71a6b-3a89-4e6b-9803-6085967a815f-audit-log\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.112427 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.112382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-metrics-server-audit-profiles\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213346 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213297    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nws5b\" (UniqueName: \"kubernetes.io/projected/68d71a6b-3a89-4e6b-9803-6085967a815f-kube-api-access-nws5b\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213379    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213413    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d71a6b-3a89-4e6b-9803-6085967a815f-audit-log\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213454    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-metrics-server-audit-profiles\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213494    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-tls\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213519 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213518    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-client-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213831 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213574    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-client-certs\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.213939 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.213917    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/68d71a6b-3a89-4e6b-9803-6085967a815f-audit-log\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.214433 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.214400    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.214566 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.214499    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/68d71a6b-3a89-4e6b-9803-6085967a815f-metrics-server-audit-profiles\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.216036 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.216008    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-client-ca-bundle\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.216124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.216064    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-tls\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.216181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.216151    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/68d71a6b-3a89-4e6b-9803-6085967a815f-secret-metrics-server-client-certs\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.221104 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.221080    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nws5b\" (UniqueName: \"kubernetes.io/projected/68d71a6b-3a89-4e6b-9803-6085967a815f-kube-api-access-nws5b\") pod \"metrics-server-86585f5fff-f8jgn\" (UID: \"68d71a6b-3a89-4e6b-9803-6085967a815f\") " pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.295129 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.295045    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:09:49.351804 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.351752    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"]
May 26 00:09:49.356934 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.356906    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:49.366132 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.365844    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 00:09:49.366315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.366170    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-zv8vw\""
May 26 00:09:49.368237 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.368188    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"]
May 26 00:09:49.438143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.438009    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86585f5fff-f8jgn"]
May 26 00:09:49.440801 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:49.440768    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d71a6b_3a89_4e6b_9803_6085967a815f.slice/crio-1596917d7c3ab8ff3f82431989c1bece54e0a440f7d950f190046840d07e4620 WatchSource:0}: Error finding container 1596917d7c3ab8ff3f82431989c1bece54e0a440f7d950f190046840d07e4620: Status 404 returned error can't find the container with id 1596917d7c3ab8ff3f82431989c1bece54e0a440f7d950f190046840d07e4620
May 26 00:09:49.516653 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.516587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05a8717b-0d14-45dc-867b-9ef6b378bcb4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vsqnc\" (UID: \"05a8717b-0d14-45dc-867b-9ef6b378bcb4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:49.617857 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.617775    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05a8717b-0d14-45dc-867b-9ef6b378bcb4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vsqnc\" (UID: \"05a8717b-0d14-45dc-867b-9ef6b378bcb4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:49.620220 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.620199    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05a8717b-0d14-45dc-867b-9ef6b378bcb4-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-vsqnc\" (UID: \"05a8717b-0d14-45dc-867b-9ef6b378bcb4\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:49.676255 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.676216    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:49.807988 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:49.807946    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"]
May 26 00:09:49.811812 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:49.811783    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a8717b_0d14_45dc_867b_9ef6b378bcb4.slice/crio-fe1b19f2e2a79803a23376324bef5bbfd8971b3fe4bac32d41b21fa8b5094161 WatchSource:0}: Error finding container fe1b19f2e2a79803a23376324bef5bbfd8971b3fe4bac32d41b21fa8b5094161: Status 404 returned error can't find the container with id fe1b19f2e2a79803a23376324bef5bbfd8971b3fe4bac32d41b21fa8b5094161
May 26 00:09:50.349993 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.349957    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc" event={"ID":"05a8717b-0d14-45dc-867b-9ef6b378bcb4","Type":"ContainerStarted","Data":"fe1b19f2e2a79803a23376324bef5bbfd8971b3fe4bac32d41b21fa8b5094161"}
May 26 00:09:50.350943 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.350919    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn" event={"ID":"68d71a6b-3a89-4e6b-9803-6085967a815f","Type":"ContainerStarted","Data":"1596917d7c3ab8ff3f82431989c1bece54e0a440f7d950f190046840d07e4620"}
May 26 00:09:50.628829 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.628692    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:09:50.634429 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.634351    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b743cdc-f2ac-44ff-b936-adad789e96b2-metrics-certs\") pod \"network-metrics-daemon-k4tkk\" (UID: \"3b743cdc-f2ac-44ff-b936-adad789e96b2\") " pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:09:50.775058 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.774770    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6mqgt\""
May 26 00:09:50.782210 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.782174    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k4tkk"
May 26 00:09:50.824374 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.823075    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:09:50.828890 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.828858    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.832729 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.832703    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 00:09:50.834050 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.834024    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6zsnc\""
May 26 00:09:50.834543 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.834524    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 00:09:50.834862 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.834803    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 00:09:50.835024 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.835007    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 00:09:50.835238 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.835222    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 00:09:50.835432 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.835415    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 00:09:50.835635 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.835618    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72vrk3edakvtc\""
May 26 00:09:50.835827 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.835811    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 00:09:50.836629 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.836593    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 00:09:50.836848 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.836830    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 00:09:50.837680 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.837512    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 00:09:50.840253 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.840071    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 00:09:50.844396 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.844319    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 00:09:50.854175 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.854146    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:09:50.930529 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.930726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljz2\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.930956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.931003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931282 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.931035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931282 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.931066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931282 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.931106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:50.931282 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:50.931137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032241    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032287    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032331    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032360    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032388    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032410    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032439    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032468    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032490    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljz2\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032536 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032518    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032559    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032592    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032647    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032672    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032706    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032750    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032780    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.032964 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.032811    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.033351 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.033246    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.036416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.035222    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.036416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.035834    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.039509 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.038116    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.039509 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.038165    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.039509 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.038929    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.040758 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.039870    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.040758 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.040571    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.042141 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.041249    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.042141 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.041723    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.042141 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.042098    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.044739 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.044689    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.048766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.048733    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljz2\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.048766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.048755    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.049114 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.049080    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.049323 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.049295    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.049916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.049896    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.051971 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.051944    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.148323 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.147747    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:09:51.807819 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.807309    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k4tkk"]
May 26 00:09:51.810839 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:51.810807    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b743cdc_f2ac_44ff_b936_adad789e96b2.slice/crio-813c4d95401a0f6d3e74432a13fdbbefdfa44a3699cc308d13d891d30ba2867a WatchSource:0}: Error finding container 813c4d95401a0f6d3e74432a13fdbbefdfa44a3699cc308d13d891d30ba2867a: Status 404 returned error can't find the container with id 813c4d95401a0f6d3e74432a13fdbbefdfa44a3699cc308d13d891d30ba2867a
May 26 00:09:51.833255 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:51.833226    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:09:51.835808 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:09:51.835781    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1e99ae_cead_47a6_9148_fcf3e07387e1.slice/crio-9e3135b9b83b6a572abe8e63bf09a78eb284d52152a9a47c1c5174c2716afc3d WatchSource:0}: Error finding container 9e3135b9b83b6a572abe8e63bf09a78eb284d52152a9a47c1c5174c2716afc3d: Status 404 returned error can't find the container with id 9e3135b9b83b6a572abe8e63bf09a78eb284d52152a9a47c1c5174c2716afc3d
May 26 00:09:52.358899 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.358856    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn" event={"ID":"68d71a6b-3a89-4e6b-9803-6085967a815f","Type":"ContainerStarted","Data":"3bd3f0c80ee1347a23f328214005b326680eb34d2facfcfea14436bcc2999037"}
May 26 00:09:52.360528 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.360492    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"9e3135b9b83b6a572abe8e63bf09a78eb284d52152a9a47c1c5174c2716afc3d"}
May 26 00:09:52.362280 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.362165    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc" event={"ID":"05a8717b-0d14-45dc-867b-9ef6b378bcb4","Type":"ContainerStarted","Data":"d6143e0d4b36e62169ea602d15998d1f6d5ab060d4f845d82007c29ca1dc202d"}
May 26 00:09:52.362388 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.362344    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:52.363980 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.363940    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4tkk" event={"ID":"3b743cdc-f2ac-44ff-b936-adad789e96b2","Type":"ContainerStarted","Data":"813c4d95401a0f6d3e74432a13fdbbefdfa44a3699cc308d13d891d30ba2867a"}
May 26 00:09:52.368804 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.368781    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc"
May 26 00:09:52.377051 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.376810    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn" podStartSLOduration=2.163122916 podStartE2EDuration="4.376792829s" podCreationTimestamp="2026-05-26 00:09:48 +0000 UTC" firstStartedPulling="2026-05-26 00:09:49.442855107 +0000 UTC m=+128.190896308" lastFinishedPulling="2026-05-26 00:09:51.656525021 +0000 UTC m=+130.404566221" observedRunningTime="2026-05-26 00:09:52.37578242 +0000 UTC m=+131.123823640" watchObservedRunningTime="2026-05-26 00:09:52.376792829 +0000 UTC m=+131.124834048"
May 26 00:09:52.391643 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:52.391514    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-vsqnc" podStartSLOduration=1.546058513 podStartE2EDuration="3.391497224s" podCreationTimestamp="2026-05-26 00:09:49 +0000 UTC" firstStartedPulling="2026-05-26 00:09:49.814152205 +0000 UTC m=+128.562193407" lastFinishedPulling="2026-05-26 00:09:51.659590918 +0000 UTC m=+130.407632118" observedRunningTime="2026-05-26 00:09:52.390419357 +0000 UTC m=+131.138460589" watchObservedRunningTime="2026-05-26 00:09:52.391497224 +0000 UTC m=+131.139538443"
May 26 00:09:53.368372 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:53.368344    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c" exitCode=0
May 26 00:09:53.368777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:53.368435    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"}
May 26 00:09:53.370661 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:53.370631    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4tkk" event={"ID":"3b743cdc-f2ac-44ff-b936-adad789e96b2","Type":"ContainerStarted","Data":"c3e03b9c6b640a4a419382fea63213b4975f646f0ca21e39ce3905883a6eb35a"}
May 26 00:09:53.370782 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:53.370673    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k4tkk" event={"ID":"3b743cdc-f2ac-44ff-b936-adad789e96b2","Type":"ContainerStarted","Data":"c54a9020c4eb66a16f7aa58e8448f3a28a88a8c520b6183effd2a8884ab0d43d"}
May 26 00:09:53.407907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:53.407855    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k4tkk" podStartSLOduration=130.04406626 podStartE2EDuration="2m11.407839669s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:09:51.813171961 +0000 UTC m=+130.561213158" lastFinishedPulling="2026-05-26 00:09:53.176945367 +0000 UTC m=+131.924986567" observedRunningTime="2026-05-26 00:09:53.406817942 +0000 UTC m=+132.154859162" watchObservedRunningTime="2026-05-26 00:09:53.407839669 +0000 UTC m=+132.155880915"
May 26 00:09:56.381625 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:56.381583    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"}
May 26 00:09:57.386616 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:57.386565    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"}
May 26 00:09:58.393152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:58.393125    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"}
May 26 00:09:58.393463 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:58.393161    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"}
May 26 00:09:58.393463 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:58.393170    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"}
May 26 00:09:59.398616 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:59.398566    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerStarted","Data":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"}
May 26 00:09:59.424967 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:09:59.424912    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.144728767 podStartE2EDuration="9.424897334s" podCreationTimestamp="2026-05-26 00:09:50 +0000 UTC" firstStartedPulling="2026-05-26 00:09:51.838305749 +0000 UTC m=+130.586346950" lastFinishedPulling="2026-05-26 00:09:58.11847432 +0000 UTC m=+136.866515517" observedRunningTime="2026-05-26 00:09:59.423245832 +0000 UTC m=+138.171287056" watchObservedRunningTime="2026-05-26 00:09:59.424897334 +0000 UTC m=+138.172938595"
May 26 00:10:01.148918 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:01.148879    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:10:09.295317 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:09.295277    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:10:09.295744 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:09.295333    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:10:11.434937 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:11.434904    2560 generic.go:358] "Generic (PLEG): container finished" podID="c40378ac-aae1-4652-a23f-7271dc560aad" containerID="a5d54f4e6ee316e408b8d1350838ece326c1691f4601af23e7f34375c653a6b9" exitCode=0
May 26 00:10:11.435301 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:11.434965    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2" event={"ID":"c40378ac-aae1-4652-a23f-7271dc560aad","Type":"ContainerDied","Data":"a5d54f4e6ee316e408b8d1350838ece326c1691f4601af23e7f34375c653a6b9"}
May 26 00:10:11.435301 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:11.435229    2560 scope.go:117] "RemoveContainer" containerID="a5d54f4e6ee316e408b8d1350838ece326c1691f4601af23e7f34375c653a6b9"
May 26 00:10:12.439327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:12.439290    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sbhd2" event={"ID":"c40378ac-aae1-4652-a23f-7271dc560aad","Type":"ContainerStarted","Data":"48171c9d2a5ae5313fdae8ab05dc6bbe4acc644ed5156e3bb1d4fbeeb7753414"}
May 26 00:10:29.301184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:29.301099    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:10:29.305094 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:29.305065    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86585f5fff-f8jgn"
May 26 00:10:51.149104 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:51.149068    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:10:51.169319 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:51.169292    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:10:51.572257 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:10:51.572230    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.110198 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110162    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:09.110905 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110814    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="prometheus" containerID="cri-o://4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2" gracePeriod=600
May 26 00:11:09.110905 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110868    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy" containerID="cri-o://51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c" gracePeriod=600
May 26 00:11:09.111095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110843    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="config-reloader" containerID="cri-o://4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd" gracePeriod=600
May 26 00:11:09.111095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110838    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="thanos-sidecar" containerID="cri-o://cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b" gracePeriod=600
May 26 00:11:09.111095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110854    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa" gracePeriod=600
May 26 00:11:09.111095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.110838    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-web" containerID="cri-o://5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f" gracePeriod=600
May 26 00:11:09.371496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.371470    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.390888 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.390860    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.390900    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.390949    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.390973    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391003    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391057    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391088    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ljz2\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391118    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391144    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391174    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391198    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391229    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391258    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391317    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391330 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391323    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391344    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391377    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391406    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391428    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391438    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle\") pod \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\" (UID: \"3f1e99ae-cead-47a6-9148-fcf3e07387e1\") "
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391748    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391756    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:09.391796 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.391770    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-metrics-client-ca\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.392419 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.392390    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:09.393347 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.393309    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.394583    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.395578    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.396412    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out" (OuterVolumeSpecName: "config-out") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.397578    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config" (OuterVolumeSpecName: "config") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.397626    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.398820    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.398840    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.399002    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.399285    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.399385    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2" (OuterVolumeSpecName: "kube-api-access-4ljz2") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "kube-api-access-4ljz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:11:09.399573 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.399499    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:11:09.400839 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.400737    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.412754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.412723    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config" (OuterVolumeSpecName: "web-config") pod "3f1e99ae-cead-47a6-9148-fcf3e07387e1" (UID: "3f1e99ae-cead-47a6-9148-fcf3e07387e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:09.492315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492278    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492312    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-config-out\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492315 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492323    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-kube-rbac-proxy\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492334    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492345    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ljz2\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-kube-api-access-4ljz2\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492354    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492363    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-grpc-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492372    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492381    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-metrics-client-certs\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492389    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492400    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1e99ae-cead-47a6-9148-fcf3e07387e1-prometheus-k8s-db\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492409    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492417    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1e99ae-cead-47a6-9148-fcf3e07387e1-tls-assets\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492425    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-web-config\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492433    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1e99ae-cead-47a6-9148-fcf3e07387e1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.492567 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.492442    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1e99ae-cead-47a6-9148-fcf3e07387e1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609819    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa" exitCode=0
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609846    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c" exitCode=0
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609854    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f" exitCode=0
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609862    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b" exitCode=0
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609868    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd" exitCode=0
May 26 00:11:09.609863 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609874    2560 generic.go:358] "Generic (PLEG): container finished" podID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2" exitCode=0
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609916    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609942    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609964    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609980    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.609995    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.610008    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.610023    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.610036    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1e99ae-cead-47a6-9148-fcf3e07387e1","Type":"ContainerDied","Data":"9e3135b9b83b6a572abe8e63bf09a78eb284d52152a9a47c1c5174c2716afc3d"}
May 26 00:11:09.610184 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.610035    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.620535 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.620511    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.628092 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.628074    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.634666 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.634639    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.638352 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.638326    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:09.640838 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.640811    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:09.643095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.643076    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.649507 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.649486    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.656419 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.656401    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.663380 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663354    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:09.663818 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663800    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy"
May 26 00:11:09.663818 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663810    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.663818 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663818    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663833    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-web"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663841    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-web"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663849    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="config-reloader"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663856    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="config-reloader"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663864    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="prometheus"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663870    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="prometheus"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663879    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="init-config-reloader"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663884    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="init-config-reloader"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663893    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="thanos-sidecar"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663898    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="thanos-sidecar"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663913    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-thanos"
May 26 00:11:09.663952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663920    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-thanos"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663981    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="config-reloader"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663990    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="thanos-sidecar"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.663998    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-web"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664007    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy-thanos"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664025    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="kube-rbac-proxy"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664034    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" containerName="prometheus"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.664107    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664170    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.664416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664220    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.664540    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664569    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664592    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.664844    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664875    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.665056 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.664896    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.665343 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.665187    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.665343 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665208    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.665343 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665222    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.665519 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.665489    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.665576 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665527    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.665576 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665547    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.665808 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.665792    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.665843 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665811    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.665843 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.665823    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.666005 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:11:09.665992    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.666041 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666009    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.666041 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666025    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.666249 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666234    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.666295 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666249    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.666438 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666420    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.666486 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666438    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.666644 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666627    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.666699 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666643    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.666827 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666808    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.666871 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.666828    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.667021 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667000    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.667092 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667024    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.667217 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667201    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.667280 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667219    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.667404 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667388    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.667464 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667405    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.667625 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667592    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.667680 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667626    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.667819 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667800    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.667870 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.667820    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.668090 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.668063    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.668173 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.668092    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.668292 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.668272    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.668409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.668342    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.668409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.668366    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669324    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669349    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669539    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669558    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669765    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669783    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669947    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.669964    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670222    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670241    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670454    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.670813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670472    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670809    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.670836    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671172    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671195    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671284    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671375    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 00:11:09.671481 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671286    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671524    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671548    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671642    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-72vrk3edakvtc\""
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671749    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671818    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671842    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.671907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.671876    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672006    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672045    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6zsnc\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672088    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672097    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672088    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672200    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672204    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.672361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672229    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.672736 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672502    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.672736 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672521    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.672848 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672811    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.672848 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.672831    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.673080 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673062    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.673154 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673080    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.673333 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673308    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.673388 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673337    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.673636 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673617    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.673754 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673659    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.673921 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673896    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.673995 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.673921    2560 scope.go:117] "RemoveContainer" containerID="bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"
May 26 00:11:09.674141 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674117    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa"} err="failed to get container status \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": rpc error: code = NotFound desc = could not find container \"bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa\": container with ID starting with bacb83a0ec56db0b5e53695a0d2eac73c19861c372d7b61938ca41835c090cfa not found: ID does not exist"
May 26 00:11:09.674207 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674144    2560 scope.go:117] "RemoveContainer" containerID="51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"
May 26 00:11:09.674379 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674356    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c"} err="failed to get container status \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": rpc error: code = NotFound desc = could not find container \"51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c\": container with ID starting with 51733e82ffd9791174e0de75035df441a2e74f92a221d32244dd1d3a981c0d6c not found: ID does not exist"
May 26 00:11:09.674379 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674381    2560 scope.go:117] "RemoveContainer" containerID="5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"
May 26 00:11:09.674794 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674753    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f"} err="failed to get container status \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": rpc error: code = NotFound desc = could not find container \"5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f\": container with ID starting with 5ec06590cf46800b0cba2d9d2170dd835053005199d14551f1d213f53a2eb35f not found: ID does not exist"
May 26 00:11:09.674794 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.674778    2560 scope.go:117] "RemoveContainer" containerID="cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"
May 26 00:11:09.675076 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.675058    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b"} err="failed to get container status \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": rpc error: code = NotFound desc = could not find container \"cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b\": container with ID starting with cfe6534280de400b68c1ecc2797b97a97e6c0d632601af3b7c188b509d5e3f4b not found: ID does not exist"
May 26 00:11:09.675076 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.675077    2560 scope.go:117] "RemoveContainer" containerID="4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"
May 26 00:11:09.675506 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.675359    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 00:11:09.675630 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.675533    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd"} err="failed to get container status \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": rpc error: code = NotFound desc = could not find container \"4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd\": container with ID starting with 4b19ae03cdf538edc88ad1bebbbdf058dad81fc3777368a2522bff6e7d0e10dd not found: ID does not exist"
May 26 00:11:09.675630 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.675554    2560 scope.go:117] "RemoveContainer" containerID="4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"
May 26 00:11:09.679148 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.679117    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2"} err="failed to get container status \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": rpc error: code = NotFound desc = could not find container \"4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2\": container with ID starting with 4ecb2e6b036373d61be977ae050907c88838f39185f5842570fb21afefae1cd2 not found: ID does not exist"
May 26 00:11:09.679344 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.679151    2560 scope.go:117] "RemoveContainer" containerID="7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"
May 26 00:11:09.680320 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.679955    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 00:11:09.680642 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.680538    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c"} err="failed to get container status \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": rpc error: code = NotFound desc = could not find container \"7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c\": container with ID starting with 7e99cd377301c41f8673a990dcd37ed309f2c19b0708106582f45c1dc2429d0c not found: ID does not exist"
May 26 00:11:09.681306 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.681288    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:09.694674 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.694805 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config-out\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.694805 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.694805 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9cbs\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-kube-api-access-h9cbs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.694805 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695005 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-web-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695005 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695005 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695005 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695005 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.694971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.695377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.695208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795660 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795594    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795660 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795664    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795681    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795697    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795721    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795745    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795769    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.795907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795850    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.796220 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795902    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.796220 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.795975    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.796220 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.796024    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.796539 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.796515    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.796891 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.796868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.797228 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.797198    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798662    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798716    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config-out\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798750    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798811    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9cbs\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-kube-api-access-h9cbs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798851    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798864    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798883    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-web-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798905    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799181 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.798967    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799811 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.799433    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799811 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.799687    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799811 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.799772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.799968 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.799866    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.800204 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.800187    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.800941 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.800918    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.801000 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.800946    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-config-out\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.801308 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.801290    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-web-config\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.801812 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.801788    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.801887 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.801850    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.806695 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.806676    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9cbs\" (UniqueName: \"kubernetes.io/projected/e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24-kube-api-access-h9cbs\") pod \"prometheus-k8s-0\" (UID: \"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:09.860736 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.860707    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f1e99ae-cead-47a6-9148-fcf3e07387e1" path="/var/lib/kubelet/pods/3f1e99ae-cead-47a6-9148-fcf3e07387e1/volumes"
May 26 00:11:09.982444 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:09.982407    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:11:10.115706 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:10.115679    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 00:11:10.118042 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:11:10.118009    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b0c60a_cf7b_4b69_9be7_b5a1dd19cc24.slice/crio-752ed4ac88a09c4eb1539d1837dbc79f9de11caf5926d46d39a85b96e2f8b61b WatchSource:0}: Error finding container 752ed4ac88a09c4eb1539d1837dbc79f9de11caf5926d46d39a85b96e2f8b61b: Status 404 returned error can't find the container with id 752ed4ac88a09c4eb1539d1837dbc79f9de11caf5926d46d39a85b96e2f8b61b
May 26 00:11:10.614984 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:10.614949    2560 generic.go:358] "Generic (PLEG): container finished" podID="e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24" containerID="a3d4b2d006f1e88f60ce95fc24849f49fab4da1e9ec0b1a7e5d2549466dd12f2" exitCode=0
May 26 00:11:10.615134 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:10.614996    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerDied","Data":"a3d4b2d006f1e88f60ce95fc24849f49fab4da1e9ec0b1a7e5d2549466dd12f2"}
May 26 00:11:10.615134 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:10.615019    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"752ed4ac88a09c4eb1539d1837dbc79f9de11caf5926d46d39a85b96e2f8b61b"}
May 26 00:11:11.621151 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621109    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"fd8529391cd380eb71e27b15b3ec2db9cfe831a09792e38859dfcfd8d41c2477"}
May 26 00:11:11.621151 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621150    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"ab521a0bfc62b1e62db83fa385196d3ad3d93dcacff814a5bab4657f9572754f"}
May 26 00:11:11.621151 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621160    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"e9bf5a80f596c2a76e0bf8644a313198e79bd3cc503d3300d16fc71d153e8407"}
May 26 00:11:11.621590 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621168    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"389136851a99999900669f16013d9f1b793b6be364cb7412515a5091178ef79c"}
May 26 00:11:11.621590 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621177    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"c69aa31a9d9cf94d99cf0fc30a5aee3fbc1f8c18dbc4a86636ed1ac3d8323f6f"}
May 26 00:11:11.621590 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.621185    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24","Type":"ContainerStarted","Data":"0a617a30e9b15cc6b96c05870f2ae5b38fb20cc1f6d8af4058ab0d237e798ba6"}
May 26 00:11:11.649866 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:11.649818    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.64980245 podStartE2EDuration="2.64980245s" podCreationTimestamp="2026-05-26 00:11:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:11:11.647411396 +0000 UTC m=+210.395452617" watchObservedRunningTime="2026-05-26 00:11:11.64980245 +0000 UTC m=+210.397843668"
May 26 00:11:14.983119 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:11:14.983077    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:12:09.982865 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:09.982809    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:12:09.998744 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:09.998708    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:12:10.817011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:10.816983    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 00:12:41.788132 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:41.788103    2560 kubelet.go:1628] "Image garbage collection succeeded"
May 26 00:12:43.627401 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.627359    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5zkq4"]
May 26 00:12:43.630750 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.630730    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.633432 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.633413    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 00:12:43.637123 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.637098    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zkq4"]
May 26 00:12:43.777235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.777197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc68c807-3cfb-41d3-a9a7-73e3ea450376-original-pull-secret\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.777419 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.777257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-kubelet-config\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.777419 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.777294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-dbus\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.878327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.878223    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-dbus\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.878327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.878285    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc68c807-3cfb-41d3-a9a7-73e3ea450376-original-pull-secret\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.878327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.878320    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-kubelet-config\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.878576 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.878438    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-kubelet-config\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.878576 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.878441    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc68c807-3cfb-41d3-a9a7-73e3ea450376-dbus\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.880783 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.880750    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc68c807-3cfb-41d3-a9a7-73e3ea450376-original-pull-secret\") pod \"global-pull-secret-syncer-5zkq4\" (UID: \"dc68c807-3cfb-41d3-a9a7-73e3ea450376\") " pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:43.940569 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:43.940534    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zkq4"
May 26 00:12:44.066335 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:44.066299    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zkq4"]
May 26 00:12:44.069687 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:12:44.069652    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc68c807_3cfb_41d3_a9a7_73e3ea450376.slice/crio-9ef6e34763055fe70394cd1a14b626eb5b62d96e2aef49633bd4dfa9473a8b6e WatchSource:0}: Error finding container 9ef6e34763055fe70394cd1a14b626eb5b62d96e2aef49633bd4dfa9473a8b6e: Status 404 returned error can't find the container with id 9ef6e34763055fe70394cd1a14b626eb5b62d96e2aef49633bd4dfa9473a8b6e
May 26 00:12:44.071190 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:44.071170    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:12:44.901954 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:44.901914    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zkq4" event={"ID":"dc68c807-3cfb-41d3-a9a7-73e3ea450376","Type":"ContainerStarted","Data":"9ef6e34763055fe70394cd1a14b626eb5b62d96e2aef49633bd4dfa9473a8b6e"}
May 26 00:12:48.915158 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:48.915120    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zkq4" event={"ID":"dc68c807-3cfb-41d3-a9a7-73e3ea450376","Type":"ContainerStarted","Data":"af2827d74b7275b1d6daeac942aa273598fdfbe0295a3572123310700574e425"}
May 26 00:12:48.930907 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:12:48.930841    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5zkq4" podStartSLOduration=1.549647889 podStartE2EDuration="5.930821896s" podCreationTimestamp="2026-05-26 00:12:43 +0000 UTC" firstStartedPulling="2026-05-26 00:12:44.071326687 +0000 UTC m=+302.819367884" lastFinishedPulling="2026-05-26 00:12:48.452500694 +0000 UTC m=+307.200541891" observedRunningTime="2026-05-26 00:12:48.929844418 +0000 UTC m=+307.677885639" watchObservedRunningTime="2026-05-26 00:12:48.930821896 +0000 UTC m=+307.678863115"
May 26 00:15:04.438424 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.438383    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:15:04.441115 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.441098    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.444062 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444033    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 00:15:04.444199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444042    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 00:15:04.444199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444157    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-f7mtc\""
May 26 00:15:04.444199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444199    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 00:15:04.444451 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444436    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 00:15:04.444574 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.444557    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 00:15:04.445265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.445249    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 00:15:04.445335 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.445257    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 00:15:04.451945 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.451925    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:15:04.599647 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.599833 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.599833 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.599833 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.599833 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.600016 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.599901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh6j5\" (UniqueName: \"kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.700729 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700631    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh6j5\" (UniqueName: \"kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.700729 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700677    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.700729 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700699    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.701011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700740    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.701011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700767    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.701011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.700790    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.701011 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:15:04.700895    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 00:15:04.701011 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:15:04.700975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls podName:a6faee05-ca1a-4c18-b84f-28635ec44ce3 nodeName:}" failed. No retries permitted until 2026-05-26 00:15:05.200955484 +0000 UTC m=+443.948996685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls") pod "feast-simple-feast-setup-f58fc6c44-zwl4t" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3") : secret "feast-simple-feast-setup-online-tls" not found
May 26 00:15:04.701246 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.701223    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.703382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.703355    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.703500 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.703380    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.703500 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.703358    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:04.708961 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:04.708939    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh6j5\" (UniqueName: \"kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:05.206207 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:05.206164    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:05.208693 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:05.208670    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-zwl4t\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:05.357880 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:05.357838    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:05.487824 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:05.487744    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:15:05.491220 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:15:05.491192    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6faee05_ca1a_4c18_b84f_28635ec44ce3.slice/crio-d99009ef5de757d8bc161ec8b48474daf492b2f640a2ca2bed791b8c34ef57f0 WatchSource:0}: Error finding container d99009ef5de757d8bc161ec8b48474daf492b2f640a2ca2bed791b8c34ef57f0: Status 404 returned error can't find the container with id d99009ef5de757d8bc161ec8b48474daf492b2f640a2ca2bed791b8c34ef57f0
May 26 00:15:06.305490 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:06.305448    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"d99009ef5de757d8bc161ec8b48474daf492b2f640a2ca2bed791b8c34ef57f0"}
May 26 00:15:39.407310 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:39.407272    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"519fefe76f82844bf1818b1f8110eb5b034744b1b85a738054c9d7f6be5baab2"}
May 26 00:15:43.426372 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:43.426338    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="519fefe76f82844bf1818b1f8110eb5b034744b1b85a738054c9d7f6be5baab2" exitCode=0
May 26 00:15:43.426734 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:43.426385    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"519fefe76f82844bf1818b1f8110eb5b034744b1b85a738054c9d7f6be5baab2"}
May 26 00:15:44.431516 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:44.431481    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"4b0a2d7b917a2cb4011da217856acb375ce1f4a4f80c9550906e073a054b4edd"}
May 26 00:15:49.447702 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:49.447667    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="4b0a2d7b917a2cb4011da217856acb375ce1f4a4f80c9550906e073a054b4edd" exitCode=0
May 26 00:15:49.447702 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:49.447710    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"4b0a2d7b917a2cb4011da217856acb375ce1f4a4f80c9550906e073a054b4edd"}
May 26 00:15:49.456860 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:49.456840    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 00:15:50.455402 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:50.455364    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"4c284560db89a18686c6909fa36dec7e420a7782c414a2fdcd1f5b9270cf19ad"}
May 26 00:15:50.455904 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:50.455416    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"72ebe6bfd10622b3a74db008ae5100641146c6109809fe2a043fca40b0e130a9"}
May 26 00:15:50.455904 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:50.455432    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"d8df59bc9f6f5e34b486c6cf4d5d5752d48158bdb8b897c1d6824ad3babfb442"}
May 26 00:15:50.455904 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:50.455445    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerStarted","Data":"1edf857345952926dce1e428b88df0910d4c48e6da41363786e7a560e51ef35a"}
May 26 00:15:50.480586 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:50.480518    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podStartSLOduration=13.277035209 podStartE2EDuration="46.480499439s" podCreationTimestamp="2026-05-26 00:15:04 +0000 UTC" firstStartedPulling="2026-05-26 00:15:05.4928226 +0000 UTC m=+444.240863797" lastFinishedPulling="2026-05-26 00:15:38.69628683 +0000 UTC m=+477.444328027" observedRunningTime="2026-05-26 00:15:50.479380219 +0000 UTC m=+489.227421450" watchObservedRunningTime="2026-05-26 00:15:50.480499439 +0000 UTC m=+489.228540663"
May 26 00:15:53.358612 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.358568    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:53.359079 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.358632    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:53.359079 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.358647    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:53.359079 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.358660    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:53.360617 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.360559    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 00:15:53.360757 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.360586    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
May 26 00:15:53.360757 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.360651    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 00:15:53.360757 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:53.360566    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
May 26 00:15:55.358469 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:55.358432    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:55.358469 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:55.358473    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:55.358469 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:55.358482    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:55.358943 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:55.358490    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.359687 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.359660    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.360062 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.359749    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.360062 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.360002    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.360621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.360579    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.360737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.360656    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.360737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.360701    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.364308 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.364292    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:15:56.479574 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:15:56.479544    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:16:57.689676 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.689582    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:16:57.690215 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.690036    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="registry" containerID="cri-o://1edf857345952926dce1e428b88df0910d4c48e6da41363786e7a560e51ef35a" gracePeriod=30
May 26 00:16:57.690215 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.690178    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online" containerID="cri-o://d8df59bc9f6f5e34b486c6cf4d5d5752d48158bdb8b897c1d6824ad3babfb442" gracePeriod=30
May 26 00:16:57.690215 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.690168    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="offline" containerID="cri-o://72ebe6bfd10622b3a74db008ae5100641146c6109809fe2a043fca40b0e130a9" gracePeriod=30
May 26 00:16:57.690472 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.690269    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui" containerID="cri-o://4c284560db89a18686c6909fa36dec7e420a7782c414a2fdcd1f5b9270cf19ad" gracePeriod=30
May 26 00:16:57.935393 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.935362    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:16:57.938701 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.938678    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.941395 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.941336    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ktsv6\""
May 26 00:16:57.950933 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.950909    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:16:57.990110 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.990110 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.990363 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgf7p\" (UniqueName: \"kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.990363 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.990363 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:57.990363 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:57.990302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.090943 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.090902    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.090943 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.090944    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.090974    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgf7p\" (UniqueName: \"kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.091007    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.091031    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.091058    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:16:58.091072    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:16:58.091142    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls podName:ac94c8c0-67f5-4570-8349-f9ae44c134b0 nodeName:}" failed. No retries permitted until 2026-05-26 00:16:58.591119454 +0000 UTC m=+557.339160674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls") pod "feast-simple-feast-setup-f58fc6c44-kc428" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:16:58.091204 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:16:58.091182    2560 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:16:58.091622 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:16:58.091216    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls podName:ac94c8c0-67f5-4570-8349-f9ae44c134b0 nodeName:}" failed. No retries permitted until 2026-05-26 00:16:58.591206063 +0000 UTC m=+557.339247261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls") pod "feast-simple-feast-setup-f58fc6c44-kc428" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:16:58.091622 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.091336    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.093505 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.093483    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.093724 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.093695    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.101334 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.101307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgf7p\" (UniqueName: \"kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.595714 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.595623    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.595714 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.595685    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.598015 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.597991    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.598125 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.598038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") pod \"feast-simple-feast-setup-f58fc6c44-kc428\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") " pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.660799 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.660766    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="4c284560db89a18686c6909fa36dec7e420a7782c414a2fdcd1f5b9270cf19ad" exitCode=0
May 26 00:16:58.660799 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.660791    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="d8df59bc9f6f5e34b486c6cf4d5d5752d48158bdb8b897c1d6824ad3babfb442" exitCode=0
May 26 00:16:58.660968 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.660835    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"4c284560db89a18686c6909fa36dec7e420a7782c414a2fdcd1f5b9270cf19ad"}
May 26 00:16:58.660968 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.660867    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"d8df59bc9f6f5e34b486c6cf4d5d5752d48158bdb8b897c1d6824ad3babfb442"}
May 26 00:16:58.850051 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.849961    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:16:58.981218 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:58.981187    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:16:58.982244 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:16:58.982216    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac94c8c0_67f5_4570_8349_f9ae44c134b0.slice/crio-aeddf54600bd960b0f62413ca1a6b1b1deb081a43cd1472070724724bef4d718 WatchSource:0}: Error finding container aeddf54600bd960b0f62413ca1a6b1b1deb081a43cd1472070724724bef4d718: Status 404 returned error can't find the container with id aeddf54600bd960b0f62413ca1a6b1b1deb081a43cd1472070724724bef4d718
May 26 00:16:59.664878 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:59.664840    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"eeb34a487d86b5b4821ae7447bb2d95575de997dd036a31203c4723fc759aeb7"}
May 26 00:16:59.664878 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:16:59.664883    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"aeddf54600bd960b0f62413ca1a6b1b1deb081a43cd1472070724724bef4d718"}
May 26 00:17:03.677374 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:03.677340    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="eeb34a487d86b5b4821ae7447bb2d95575de997dd036a31203c4723fc759aeb7" exitCode=0
May 26 00:17:03.677775 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:03.677413    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"eeb34a487d86b5b4821ae7447bb2d95575de997dd036a31203c4723fc759aeb7"}
May 26 00:17:04.682142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:04.682108    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"42834bb161ac54e4dd7abe5832e4e219bdf6628d2ac403e0a4dcb1e058105171"}
May 26 00:17:06.361478 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:06.361424    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 00:17:06.477041 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:06.476995    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 00:17:09.700412 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:09.700382    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="42834bb161ac54e4dd7abe5832e4e219bdf6628d2ac403e0a4dcb1e058105171" exitCode=0
May 26 00:17:09.700792 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:09.700455    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"42834bb161ac54e4dd7abe5832e4e219bdf6628d2ac403e0a4dcb1e058105171"}
May 26 00:17:10.707725 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.707679    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"9820f7e1eda5d978318e92b53137c60fd7a8b3035275e53bb4ff130ca9ac5900"}
May 26 00:17:10.708205 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.707737    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"50f437c89c3943a3137a90b99eb1f66db6eaf0535f4d3b9e2f88e38a3f6694ba"}
May 26 00:17:10.708205 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.707754    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"8c1e13b036974b20b060cb592843ed978efa43134f8c57bf1f6e89887c27b8cc"}
May 26 00:17:10.708205 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.707767    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerStarted","Data":"ab4a2f50264737c8344c9d5f363344d785d5ad09b26864994e34e7f88d52c7f2"}
May 26 00:17:10.733019 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.732959    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podStartSLOduration=13.732940487 podStartE2EDuration="13.732940487s" podCreationTimestamp="2026-05-26 00:16:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:17:10.731505141 +0000 UTC m=+569.479546360" watchObservedRunningTime="2026-05-26 00:17:10.732940487 +0000 UTC m=+569.480981708"
May 26 00:17:10.850285 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.850123    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:10.850285 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.850188    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:10.850560 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.850343    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:10.850560 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.850378    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:10.852649 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.852489    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
May 26 00:17:10.852649 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.852534    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
May 26 00:17:10.852649 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.852551    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 00:17:10.852913 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:10.852664    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 00:17:13.851243 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:13.851198    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
May 26 00:17:13.851819 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:13.851200    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
May 26 00:17:13.851975 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:13.851199    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 00:17:13.851975 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:13.851229    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 00:17:16.361096 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.361049    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 00:17:16.477114 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.477070    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 00:17:16.851350 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.851323    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.851494 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.851425    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.851682 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.851666    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852128 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852099    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852252 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852136    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852252 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852150    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852252 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852216    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852411 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852342    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.852641 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.852626    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:16.855870 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:16.855853    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:17.736999 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:17.736966    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:17.740127 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:17.740103    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:17:26.361287 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:26.361237    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
May 26 00:17:26.361710 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:26.361403    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:17:26.476861 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:26.476815    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
May 26 00:17:26.477018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:26.476950    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:17:27.769813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:27.769781    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="72ebe6bfd10622b3a74db008ae5100641146c6109809fe2a043fca40b0e130a9" exitCode=137
May 26 00:17:27.769813 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:27.769810    2560 generic.go:358] "Generic (PLEG): container finished" podID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerID="1edf857345952926dce1e428b88df0910d4c48e6da41363786e7a560e51ef35a" exitCode=137
May 26 00:17:27.770185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:27.769829    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"72ebe6bfd10622b3a74db008ae5100641146c6109809fe2a043fca40b0e130a9"}
May 26 00:17:27.770185 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:27.769854    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"1edf857345952926dce1e428b88df0910d4c48e6da41363786e7a560e51ef35a"}
May 26 00:17:28.334068 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.334044    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:17:28.471760 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471680    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.471760 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471736    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.472020 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471841    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh6j5\" (UniqueName: \"kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.472020 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471919    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.472020 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471937    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.472020 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.471985    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls\") pod \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\" (UID: \"a6faee05-ca1a-4c18-b84f-28635ec44ce3\") "
May 26 00:17:28.472317 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.472287    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data" (OuterVolumeSpecName: "feast-data") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:17:28.474143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.474114    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:17:28.474143 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.474134    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:17:28.474283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.474146    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls" (OuterVolumeSpecName: "online-tls") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:17:28.474319 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.474303    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:17:28.474441 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.474419    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5" (OuterVolumeSpecName: "kube-api-access-rh6j5") pod "a6faee05-ca1a-4c18-b84f-28635ec44ce3" (UID: "a6faee05-ca1a-4c18-b84f-28635ec44ce3"). InnerVolumeSpecName "kube-api-access-rh6j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:17:28.573572 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573543    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-offline-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.573572 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573569    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-ui-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.573572 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573578    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6faee05-ca1a-4c18-b84f-28635ec44ce3-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.573820 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573588    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh6j5\" (UniqueName: \"kubernetes.io/projected/a6faee05-ca1a-4c18-b84f-28635ec44ce3-kube-api-access-rh6j5\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.573820 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573608    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.573820 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.573617    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6faee05-ca1a-4c18-b84f-28635ec44ce3-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:17:28.775713 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.775622    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t" event={"ID":"a6faee05-ca1a-4c18-b84f-28635ec44ce3","Type":"ContainerDied","Data":"d99009ef5de757d8bc161ec8b48474daf492b2f640a2ca2bed791b8c34ef57f0"}
May 26 00:17:28.775713 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.775672    2560 scope.go:117] "RemoveContainer" containerID="4c284560db89a18686c6909fa36dec7e420a7782c414a2fdcd1f5b9270cf19ad"
May 26 00:17:28.776212 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.775716    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"
May 26 00:17:28.784490 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.784474    2560 scope.go:117] "RemoveContainer" containerID="72ebe6bfd10622b3a74db008ae5100641146c6109809fe2a043fca40b0e130a9"
May 26 00:17:28.791622 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.791586    2560 scope.go:117] "RemoveContainer" containerID="d8df59bc9f6f5e34b486c6cf4d5d5752d48158bdb8b897c1d6824ad3babfb442"
May 26 00:17:28.801189 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.801163    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:17:28.802403 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.802385    2560 scope.go:117] "RemoveContainer" containerID="1edf857345952926dce1e428b88df0910d4c48e6da41363786e7a560e51ef35a"
May 26 00:17:28.802663 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.802641    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-zwl4t"]
May 26 00:17:28.809203 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.809186    2560 scope.go:117] "RemoveContainer" containerID="4b0a2d7b917a2cb4011da217856acb375ce1f4a4f80c9550906e073a054b4edd"
May 26 00:17:28.816238 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:28.816222    2560 scope.go:117] "RemoveContainer" containerID="519fefe76f82844bf1818b1f8110eb5b034744b1b85a738054c9d7f6be5baab2"
May 26 00:17:29.860889 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:17:29.860855    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" path="/var/lib/kubelet/pods/a6faee05-ca1a-4c18-b84f-28635ec44ce3/volumes"
May 26 00:18:19.555869 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.555833    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556161    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="offline"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556174    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="offline"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556187    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="feast-apply"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556193    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="feast-apply"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556201    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="feast-init"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556207    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="feast-init"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556218    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="registry"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556223    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="registry"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556230    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556246    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556296    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="online"
May 26 00:18:19.556298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556304    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="registry"
May 26 00:18:19.556834 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556311    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="offline"
May 26 00:18:19.556834 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.556317    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6faee05-ca1a-4c18-b84f-28635ec44ce3" containerName="ui"
May 26 00:18:19.558695 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.558676    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.561658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561564    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 00:18:19.561658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561634    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 00:18:19.561916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561687    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 00:18:19.561916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561700    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 00:18:19.561916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561726    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 00:18:19.562102 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.561970    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-5cpqs\""
May 26 00:18:19.562102 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.562002    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 26 00:18:19.562102 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.562022    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 00:18:19.567761 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.567739    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:18:19.672260 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.672260 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz8ms\" (UniqueName: \"kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.672496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.672496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.672496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.672496 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.672441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773681 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773637    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773696    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lz8ms\" (UniqueName: \"kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773751    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773773    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:18:19.773776    2560 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773808    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:18:19.773848    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls podName:336eef77-b6ee-4c44-9ad5-759b3e430ddc nodeName:}" failed. No retries permitted until 2026-05-26 00:18:20.273830414 +0000 UTC m=+639.021871611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls") pod "feast-simple-feast-remote-setup-8744487c6-rcdgs" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 00:18:19.773881 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.773866    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.774265 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:18:19.773946    2560 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 00:18:19.774265 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:18:19.774027    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls podName:336eef77-b6ee-4c44-9ad5-759b3e430ddc nodeName:}" failed. No retries permitted until 2026-05-26 00:18:20.274006709 +0000 UTC m=+639.022047924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls") pod "feast-simple-feast-remote-setup-8744487c6-rcdgs" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 00:18:19.774265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.774201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.774482 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.774463    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.776245 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.776221    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:19.782208 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:19.782187    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz8ms\" (UniqueName: \"kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.278697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.278645    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.278923 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.278795    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.281206 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.281182    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.281300 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.281204    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") pod \"feast-simple-feast-remote-setup-8744487c6-rcdgs\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.468781 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.468742    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:20.602149 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.602123    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:18:20.603661 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:18:20.603634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod336eef77_b6ee_4c44_9ad5_759b3e430ddc.slice/crio-3b5230eff70dc78d28536bb22ef92786cfea1f3dcdca67390a1da36b2d2a06b5 WatchSource:0}: Error finding container 3b5230eff70dc78d28536bb22ef92786cfea1f3dcdca67390a1da36b2d2a06b5: Status 404 returned error can't find the container with id 3b5230eff70dc78d28536bb22ef92786cfea1f3dcdca67390a1da36b2d2a06b5
May 26 00:18:20.605326 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.605309    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:18:20.931766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.931729    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"937915ef788d5b62b4bcfcc9936bb0826a8365efac9dbbc94cd2e13c46990ab4"}
May 26 00:18:20.931766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:20.931768    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"3b5230eff70dc78d28536bb22ef92786cfea1f3dcdca67390a1da36b2d2a06b5"}
May 26 00:18:25.948559 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:25.948517    2560 generic.go:358] "Generic (PLEG): container finished" podID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerID="937915ef788d5b62b4bcfcc9936bb0826a8365efac9dbbc94cd2e13c46990ab4" exitCode=0
May 26 00:18:25.948949 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:25.948594    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"937915ef788d5b62b4bcfcc9936bb0826a8365efac9dbbc94cd2e13c46990ab4"}
May 26 00:18:26.953672 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:26.953633    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"3e7ad1a10716cdf3c326ead816e43206afee66f8dbbc6bfea22a2864db8a7efb"}
May 26 00:18:31.970275 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:31.970174    2560 generic.go:358] "Generic (PLEG): container finished" podID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerID="3e7ad1a10716cdf3c326ead816e43206afee66f8dbbc6bfea22a2864db8a7efb" exitCode=0
May 26 00:18:31.970275 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:31.970216    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"3e7ad1a10716cdf3c326ead816e43206afee66f8dbbc6bfea22a2864db8a7efb"}
May 26 00:18:32.985676 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:32.985636    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"edaa72cfb6fb63e64ed77304d8f871a93542f84bb179704843fb8c5ed2073bb8"}
May 26 00:18:32.986090 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:32.985692    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"4e451e9fffc1f6422e15c7eb098842542f73fe5f5701f8eb9e2d79ab80d02d9a"}
May 26 00:18:32.986090 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:32.985707    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerStarted","Data":"d11c1ae21659e71962e242580973182acec98f072fd8c750f1818c4ab0cf1152"}
May 26 00:18:33.008142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:33.008089    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podStartSLOduration=14.008068183 podStartE2EDuration="14.008068183s" podCreationTimestamp="2026-05-26 00:18:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:18:33.006408858 +0000 UTC m=+651.754450090" watchObservedRunningTime="2026-05-26 00:18:33.008068183 +0000 UTC m=+651.756109404"
May 26 00:18:35.469841 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.469771    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:35.469841 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.469818    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:35.469841 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.469830    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:35.471641 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.471589    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
May 26 00:18:35.471773 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.471640    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 00:18:35.471884 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:35.471851    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 00:18:38.470883 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.470852    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.471249 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.470970    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.471358 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.471339    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.471424 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.471373    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.471563 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.471548    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.471797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.471782    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:38.474912 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:38.474889    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:39.007234 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:39.007200    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:18:39.010140 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:18:39.010117    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:19:40.883265 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:40.883178    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:19:40.884273 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:40.884210    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online" containerID="cri-o://d11c1ae21659e71962e242580973182acec98f072fd8c750f1818c4ab0cf1152" gracePeriod=30
May 26 00:19:40.884436 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:40.884264    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="offline" containerID="cri-o://4e451e9fffc1f6422e15c7eb098842542f73fe5f5701f8eb9e2d79ab80d02d9a" gracePeriod=30
May 26 00:19:40.884436 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:40.884393    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui" containerID="cri-o://edaa72cfb6fb63e64ed77304d8f871a93542f84bb179704843fb8c5ed2073bb8" gracePeriod=30
May 26 00:19:41.005957 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:41.005920    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:19:41.006582 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:41.006550    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry" containerID="cri-o://ab4a2f50264737c8344c9d5f363344d785d5ad09b26864994e34e7f88d52c7f2" gracePeriod=30
May 26 00:19:41.006994 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:41.006964    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline" containerID="cri-o://50f437c89c3943a3137a90b99eb1f66db6eaf0535f4d3b9e2f88e38a3f6694ba" gracePeriod=30
May 26 00:19:41.007305 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:41.006995    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" containerID="cri-o://9820f7e1eda5d978318e92b53137c60fd7a8b3035275e53bb4ff130ca9ac5900" gracePeriod=30
May 26 00:19:41.007411 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:41.007087    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" containerID="cri-o://8c1e13b036974b20b060cb592843ed978efa43134f8c57bf1f6e89887c27b8cc" gracePeriod=30
May 26 00:19:42.196155 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.196114    2560 generic.go:358] "Generic (PLEG): container finished" podID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerID="edaa72cfb6fb63e64ed77304d8f871a93542f84bb179704843fb8c5ed2073bb8" exitCode=0
May 26 00:19:42.196155 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.196141    2560 generic.go:358] "Generic (PLEG): container finished" podID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerID="d11c1ae21659e71962e242580973182acec98f072fd8c750f1818c4ab0cf1152" exitCode=0
May 26 00:19:42.196697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.196181    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"edaa72cfb6fb63e64ed77304d8f871a93542f84bb179704843fb8c5ed2073bb8"}
May 26 00:19:42.196697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.196217    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"d11c1ae21659e71962e242580973182acec98f072fd8c750f1818c4ab0cf1152"}
May 26 00:19:42.198561 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.198538    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="9820f7e1eda5d978318e92b53137c60fd7a8b3035275e53bb4ff130ca9ac5900" exitCode=0
May 26 00:19:42.198561 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.198558    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="8c1e13b036974b20b060cb592843ed978efa43134f8c57bf1f6e89887c27b8cc" exitCode=0
May 26 00:19:42.198698 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.198588    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"9820f7e1eda5d978318e92b53137c60fd7a8b3035275e53bb4ff130ca9ac5900"}
May 26 00:19:42.198698 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:42.198622    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"8c1e13b036974b20b060cb592843ed978efa43134f8c57bf1f6e89887c27b8cc"}
May 26 00:19:46.852576 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:46.852520    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 00:19:47.737948 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:47.737901    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 00:19:48.472532 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:48.472472    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 00:19:49.007725 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:49.007679    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 00:19:56.852791 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:56.852744    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 00:19:57.737505 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:57.737463    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 00:19:58.471531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:58.471480    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 00:19:59.008465 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:19:59.008415    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 00:20:06.852495 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:06.852446    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
May 26 00:20:06.852954 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:06.852636    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:20:07.737427 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:07.737382    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
May 26 00:20:07.737628 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:07.737517    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:20:08.472177 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:08.472126    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
May 26 00:20:08.472655 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:08.472286    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:20:09.007876 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:09.007833    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
May 26 00:20:09.008052 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:09.007971    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:20:11.284931 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.284898    2560 generic.go:358] "Generic (PLEG): container finished" podID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerID="4e451e9fffc1f6422e15c7eb098842542f73fe5f5701f8eb9e2d79ab80d02d9a" exitCode=137
May 26 00:20:11.285332 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.284972    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"4e451e9fffc1f6422e15c7eb098842542f73fe5f5701f8eb9e2d79ab80d02d9a"}
May 26 00:20:11.287393 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.287371    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="50f437c89c3943a3137a90b99eb1f66db6eaf0535f4d3b9e2f88e38a3f6694ba" exitCode=137
May 26 00:20:11.287393 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.287389    2560 generic.go:358] "Generic (PLEG): container finished" podID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerID="ab4a2f50264737c8344c9d5f363344d785d5ad09b26864994e34e7f88d52c7f2" exitCode=137
May 26 00:20:11.287546 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.287415    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"50f437c89c3943a3137a90b99eb1f66db6eaf0535f4d3b9e2f88e38a3f6694ba"}
May 26 00:20:11.287546 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.287436    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"ab4a2f50264737c8344c9d5f363344d785d5ad09b26864994e34e7f88d52c7f2"}
May 26 00:20:11.537493 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.537440    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:20:11.592016 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.591989    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz8ms\" (UniqueName: \"kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592040    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592064    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592091    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592108    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592152 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592125    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls\") pod \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\" (UID: \"336eef77-b6ee-4c44-9ad5-759b3e430ddc\") "
May 26 00:20:11.592693 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592642    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:20:11.592820 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.592726    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data" (OuterVolumeSpecName: "feast-data") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:20:11.596513 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.596491    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.596672 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.596651    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms" (OuterVolumeSpecName: "kube-api-access-lz8ms") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "kube-api-access-lz8ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:20:11.596728 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.596652    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls" (OuterVolumeSpecName: "online-tls") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.596764 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.596740    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "336eef77-b6ee-4c44-9ad5-759b3e430ddc" (UID: "336eef77-b6ee-4c44-9ad5-759b3e430ddc"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.659299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.659274    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:20:11.693216 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693187    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693228    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693268    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693299    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgf7p\" (UniqueName: \"kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693322    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693346    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data\") pod \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\" (UID: \"ac94c8c0-67f5-4570-8349-f9ae44c134b0\") "
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693574    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz8ms\" (UniqueName: \"kubernetes.io/projected/336eef77-b6ee-4c44-9ad5-759b3e430ddc-kube-api-access-lz8ms\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693611    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/336eef77-b6ee-4c44-9ad5-759b3e430ddc-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693629    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693643    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-ui-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693655    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/336eef77-b6ee-4c44-9ad5-759b3e430ddc-offline-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.693683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.693667    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/336eef77-b6ee-4c44-9ad5-759b3e430ddc-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.694138 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.694102    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data" (OuterVolumeSpecName: "feast-data") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:20:11.695658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.695633    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls" (OuterVolumeSpecName: "online-tls") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.695804 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.695776    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.695884 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.695817    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.695884 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.695827    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p" (OuterVolumeSpecName: "kube-api-access-tgf7p") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "kube-api-access-tgf7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:20:11.696136 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.696116    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ac94c8c0-67f5-4570-8349-f9ae44c134b0" (UID: "ac94c8c0-67f5-4570-8349-f9ae44c134b0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794464    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-offline-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794489    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794498    2560 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-ui-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794506    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgf7p\" (UniqueName: \"kubernetes.io/projected/ac94c8c0-67f5-4570-8349-f9ae44c134b0-kube-api-access-tgf7p\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794519    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac94c8c0-67f5-4570-8349-f9ae44c134b0-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:11.794538 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:11.794528    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac94c8c0-67f5-4570-8349-f9ae44c134b0-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:20:12.292584 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.292556    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"
May 26 00:20:12.293069 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.292558    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs" event={"ID":"336eef77-b6ee-4c44-9ad5-759b3e430ddc","Type":"ContainerDied","Data":"3b5230eff70dc78d28536bb22ef92786cfea1f3dcdca67390a1da36b2d2a06b5"}
May 26 00:20:12.293069 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.292702    2560 scope.go:117] "RemoveContainer" containerID="edaa72cfb6fb63e64ed77304d8f871a93542f84bb179704843fb8c5ed2073bb8"
May 26 00:20:12.295541 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.295491    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428" event={"ID":"ac94c8c0-67f5-4570-8349-f9ae44c134b0","Type":"ContainerDied","Data":"aeddf54600bd960b0f62413ca1a6b1b1deb081a43cd1472070724724bef4d718"}
May 26 00:20:12.295674 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.295548    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"
May 26 00:20:12.301991 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.301973    2560 scope.go:117] "RemoveContainer" containerID="4e451e9fffc1f6422e15c7eb098842542f73fe5f5701f8eb9e2d79ab80d02d9a"
May 26 00:20:12.309303 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.309283    2560 scope.go:117] "RemoveContainer" containerID="d11c1ae21659e71962e242580973182acec98f072fd8c750f1818c4ab0cf1152"
May 26 00:20:12.312524 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.312502    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:20:12.316194 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.316173    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8744487c6-rcdgs"]
May 26 00:20:12.317662 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.317642    2560 scope.go:117] "RemoveContainer" containerID="3e7ad1a10716cdf3c326ead816e43206afee66f8dbbc6bfea22a2864db8a7efb"
May 26 00:20:12.324447 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.324431    2560 scope.go:117] "RemoveContainer" containerID="937915ef788d5b62b4bcfcc9936bb0826a8365efac9dbbc94cd2e13c46990ab4"
May 26 00:20:12.330530 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.330493    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:20:12.337977 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.333081    2560 scope.go:117] "RemoveContainer" containerID="9820f7e1eda5d978318e92b53137c60fd7a8b3035275e53bb4ff130ca9ac5900"
May 26 00:20:12.337977 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.333533    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f58fc6c44-kc428"]
May 26 00:20:12.345512 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.345495    2560 scope.go:117] "RemoveContainer" containerID="50f437c89c3943a3137a90b99eb1f66db6eaf0535f4d3b9e2f88e38a3f6694ba"
May 26 00:20:12.352217 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.352198    2560 scope.go:117] "RemoveContainer" containerID="8c1e13b036974b20b060cb592843ed978efa43134f8c57bf1f6e89887c27b8cc"
May 26 00:20:12.358826 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.358809    2560 scope.go:117] "RemoveContainer" containerID="ab4a2f50264737c8344c9d5f363344d785d5ad09b26864994e34e7f88d52c7f2"
May 26 00:20:12.366382 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.366361    2560 scope.go:117] "RemoveContainer" containerID="42834bb161ac54e4dd7abe5832e4e219bdf6628d2ac403e0a4dcb1e058105171"
May 26 00:20:12.373251 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:12.373235    2560 scope.go:117] "RemoveContainer" containerID="eeb34a487d86b5b4821ae7447bb2d95575de997dd036a31203c4723fc759aeb7"
May 26 00:20:13.860656 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:13.860621    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" path="/var/lib/kubelet/pods/336eef77-b6ee-4c44-9ad5-759b3e430ddc/volumes"
May 26 00:20:13.861176 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:13.861163    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" path="/var/lib/kubelet/pods/ac94c8c0-67f5-4570-8349-f9ae44c134b0/volumes"
May 26 00:20:23.830446 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830412    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830832    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830852    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830870    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830878    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830887    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830894    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830902    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="feast-init"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="feast-init"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830920    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="feast-init"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830927    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="feast-init"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830939    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830946    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830961    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="feast-apply"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830969    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="feast-apply"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830983    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="feast-apply"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.830991    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="feast-apply"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831001    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831009    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online"
May 26 00:20:23.831008 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831020    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831028    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831035    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831040    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831098    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831105    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="online"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831110    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="registry"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831118    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="ui"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831125    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="offline"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831131    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac94c8c0-67f5-4570-8349-f9ae44c134b0" containerName="ui"
May 26 00:20:23.831621 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.831137    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="336eef77-b6ee-4c44-9ad5-759b3e430ddc" containerName="online"
May 26 00:20:23.836361 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.836341    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.839246 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.839223    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 00:20:23.839371 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.839253    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 26 00:20:23.839371 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.839270    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 00:20:23.839489 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.839420    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-5w5cs\""
May 26 00:20:23.839982 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.839949    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:20:23.887952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.887920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.888108 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.887976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn54x\" (UniqueName: \"kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.989188 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.989152    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.989354 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.989201    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn54x\" (UniqueName: \"kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.989520 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.989501    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:23.997078 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:23.997060    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn54x\" (UniqueName: \"kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x\") pod \"postgres-7c7656cc6d-dt72l\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") " pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:24.156981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:24.156894    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:20:24.284108 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:24.284075    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:20:24.287734 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:20:24.287702    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e3bccd6_6986_49ba_ad42_61aa2a955c70.slice/crio-ed92d314dfef1b77f087ebd31fc2bcc6a41a4d9d9ad176030af057ca3d918117 WatchSource:0}: Error finding container ed92d314dfef1b77f087ebd31fc2bcc6a41a4d9d9ad176030af057ca3d918117: Status 404 returned error can't find the container with id ed92d314dfef1b77f087ebd31fc2bcc6a41a4d9d9ad176030af057ca3d918117
May 26 00:20:24.333034 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:24.332997    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" event={"ID":"2e3bccd6-6986-49ba-ad42-61aa2a955c70","Type":"ContainerStarted","Data":"ed92d314dfef1b77f087ebd31fc2bcc6a41a4d9d9ad176030af057ca3d918117"}
May 26 00:20:31.356223 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:31.356181    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" event={"ID":"2e3bccd6-6986-49ba-ad42-61aa2a955c70","Type":"ContainerStarted","Data":"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"}
May 26 00:20:31.370319 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:31.370206    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" podStartSLOduration=1.542726428 podStartE2EDuration="8.370186866s" podCreationTimestamp="2026-05-26 00:20:23 +0000 UTC" firstStartedPulling="2026-05-26 00:20:24.290085267 +0000 UTC m=+763.038126479" lastFinishedPulling="2026-05-26 00:20:31.117545721 +0000 UTC m=+769.865586917" observedRunningTime="2026-05-26 00:20:31.369873204 +0000 UTC m=+770.117914423" watchObservedRunningTime="2026-05-26 00:20:31.370186866 +0000 UTC m=+770.118228086"
May 26 00:20:34.509061 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.509024    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:20:34.511667 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.511650    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.514905 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.514882    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-pj2sg\""
May 26 00:20:34.515148 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.515129    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 26 00:20:34.515218 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.515166    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 26 00:20:34.516207 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.516191    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 00:20:34.516293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.516233    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 26 00:20:34.529280 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.529260    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:20:34.584957 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.584917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vm9\" (UniqueName: \"kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.584957 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.584960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.585175 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.585061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.585175 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.585116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.585175 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.585152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.686485 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.686450    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.686697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.686497    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.686697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.686536    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.686697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.686572    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vm9\" (UniqueName: \"kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.686697 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.686592    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.687048 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.687026    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.689222 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.689195    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.689327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.689235    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.689327 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.689235    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.693857 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.693838    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vm9\" (UniqueName: \"kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9\") pod \"feast-credit-scoring-8476475979-znwsg\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") " pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.820922 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.820832    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:34.949816 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:34.949791    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:20:34.951694 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:20:34.951663    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4b36cd_b42f_4d12_8112_9812cb74c9d5.slice/crio-5b2a2f27b3b16e1c97f409d4f66a2e27c848e37fbad535c06307d6670a275848 WatchSource:0}: Error finding container 5b2a2f27b3b16e1c97f409d4f66a2e27c848e37fbad535c06307d6670a275848: Status 404 returned error can't find the container with id 5b2a2f27b3b16e1c97f409d4f66a2e27c848e37fbad535c06307d6670a275848
May 26 00:20:35.374917 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:35.374875    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"}
May 26 00:20:35.374917 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:35.374918    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"5b2a2f27b3b16e1c97f409d4f66a2e27c848e37fbad535c06307d6670a275848"}
May 26 00:20:36.379031 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:36.378997    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerID="962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6" exitCode=0
May 26 00:20:36.379436 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:36.379085    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"}
May 26 00:20:37.386678 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:37.386641    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"}
May 26 00:20:43.404554 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:43.404513    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerID="b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4" exitCode=0
May 26 00:20:43.404960 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:43.404586    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"}
May 26 00:20:43.408222 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:43.408197    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 00:20:44.410919 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.410883    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"}
May 26 00:20:44.411283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.410932    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"}
May 26 00:20:44.411283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.410949    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerStarted","Data":"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"}
May 26 00:20:44.435228 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.435182    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podStartSLOduration=10.435168123 podStartE2EDuration="10.435168123s" podCreationTimestamp="2026-05-26 00:20:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:20:44.433508258 +0000 UTC m=+783.181549499" watchObservedRunningTime="2026-05-26 00:20:44.435168123 +0000 UTC m=+783.183209342"
May 26 00:20:44.821348 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.821262    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:44.821348 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.821311    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:44.821348 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:44.821323    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:46.821826 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.821774    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:46.821826 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.821832    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:46.822353 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.821845    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:46.823461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.823429    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 26 00:20:46.823591 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.823463    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 26 00:20:46.823591 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:46.823467    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused"
May 26 00:20:49.821636 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:49.821576    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 26 00:20:49.822554 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:49.822527    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:49.823511 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:49.823488    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:49.827203 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:49.827175    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:50.435150 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:50.435125    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:52.821673 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:52.821630    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 26 00:20:55.821838 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:55.821811    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:20:55.822511 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:20:55.822492    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:21:55.673916 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.673884    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:21:55.674338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.674199    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry" containerID="cri-o://3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804" gracePeriod=30
May 26 00:21:55.674338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.674244    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="offline" containerID="cri-o://1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917" gracePeriod=30
May 26 00:21:55.674338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.674246    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online" containerID="cri-o://d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e" gracePeriod=30
May 26 00:21:55.690725 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.690698    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:21:55.690870 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.690854    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" podUID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" containerName="postgres" containerID="cri-o://519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0" gracePeriod=30
May 26 00:21:55.931042 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.930988    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:21:55.974173 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.974144    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata\") pod \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") "
May 26 00:21:55.974328 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.974184    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn54x\" (UniqueName: \"kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x\") pod \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\" (UID: \"2e3bccd6-6986-49ba-ad42-61aa2a955c70\") "
May 26 00:21:55.976236 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:55.976215    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x" (OuterVolumeSpecName: "kube-api-access-gn54x") pod "2e3bccd6-6986-49ba-ad42-61aa2a955c70" (UID: "2e3bccd6-6986-49ba-ad42-61aa2a955c70"). InnerVolumeSpecName "kube-api-access-gn54x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:21:56.007898 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.007869    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "2e3bccd6-6986-49ba-ad42-61aa2a955c70" (UID: "2e3bccd6-6986-49ba-ad42-61aa2a955c70"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:21:56.075367 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.075322    2560 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2e3bccd6-6986-49ba-ad42-61aa2a955c70-postgresdata\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:21:56.075367 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.075364    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn54x\" (UniqueName: \"kubernetes.io/projected/2e3bccd6-6986-49ba-ad42-61aa2a955c70-kube-api-access-gn54x\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:21:56.624170 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.624093    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerID="d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e" exitCode=0
May 26 00:21:56.624310 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.624166    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"}
May 26 00:21:56.625158 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.625135    2560 generic.go:358] "Generic (PLEG): container finished" podID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" containerID="519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0" exitCode=0
May 26 00:21:56.625260 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.625189    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" event={"ID":"2e3bccd6-6986-49ba-ad42-61aa2a955c70","Type":"ContainerDied","Data":"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"}
May 26 00:21:56.625260 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.625211    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dt72l" event={"ID":"2e3bccd6-6986-49ba-ad42-61aa2a955c70","Type":"ContainerDied","Data":"ed92d314dfef1b77f087ebd31fc2bcc6a41a4d9d9ad176030af057ca3d918117"}
May 26 00:21:56.625260 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.625225    2560 scope.go:117] "RemoveContainer" containerID="519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"
May 26 00:21:56.625375 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.625192    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dt72l"
May 26 00:21:56.634191 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.634177    2560 scope.go:117] "RemoveContainer" containerID="519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"
May 26 00:21:56.634430 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:21:56.634413    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0\": container with ID starting with 519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0 not found: ID does not exist" containerID="519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"
May 26 00:21:56.634492 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.634437    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0"} err="failed to get container status \"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0\": rpc error: code = NotFound desc = could not find container \"519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0\": container with ID starting with 519d90be17d6cc99e31740d09730898afff803a88c96b44bc3b39393478459a0 not found: ID does not exist"
May 26 00:21:56.646236 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.646217    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:21:56.651589 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:56.651566    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dt72l"]
May 26 00:21:57.860341 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:21:57.860310    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" path="/var/lib/kubelet/pods/2e3bccd6-6986-49ba-ad42-61aa2a955c70/volumes"
May 26 00:22:00.433049 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:00.433009    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 26 00:22:10.433097 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:10.433056    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 26 00:22:20.432466 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:20.432423    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused"
May 26 00:22:20.432952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:20.432577    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:22:25.714021 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:25.713992    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerID="1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917" exitCode=137
May 26 00:22:25.714386 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:25.714076    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"}
May 26 00:22:25.822722 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:25.822689    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused"
May 26 00:22:26.314505 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.314485    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:22:26.428274 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.428244    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls\") pod \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") "
May 26 00:22:26.428274 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.428279    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls\") pod \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") "
May 26 00:22:26.428484 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.428324    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data\") pod \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") "
May 26 00:22:26.428484 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.428372    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4vm9\" (UniqueName: \"kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9\") pod \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") "
May 26 00:22:26.428484 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.428404    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls\") pod \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\" (UID: \"9b4b36cd-b42f-4d12-8112-9812cb74c9d5\") "
May 26 00:22:26.430540 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.430513    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls" (OuterVolumeSpecName: "online-tls") pod "9b4b36cd-b42f-4d12-8112-9812cb74c9d5" (UID: "9b4b36cd-b42f-4d12-8112-9812cb74c9d5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:22:26.430681 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.430557    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9b4b36cd-b42f-4d12-8112-9812cb74c9d5" (UID: "9b4b36cd-b42f-4d12-8112-9812cb74c9d5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:22:26.430840 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.430817    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9" (OuterVolumeSpecName: "kube-api-access-m4vm9") pod "9b4b36cd-b42f-4d12-8112-9812cb74c9d5" (UID: "9b4b36cd-b42f-4d12-8112-9812cb74c9d5"). InnerVolumeSpecName "kube-api-access-m4vm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:22:26.430882 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.430835    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b4b36cd-b42f-4d12-8112-9812cb74c9d5" (UID: "9b4b36cd-b42f-4d12-8112-9812cb74c9d5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:22:26.436546 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.436526    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data" (OuterVolumeSpecName: "feast-data") pod "9b4b36cd-b42f-4d12-8112-9812cb74c9d5" (UID: "9b4b36cd-b42f-4d12-8112-9812cb74c9d5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:22:26.529299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.529237    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:22:26.529299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.529260    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4vm9\" (UniqueName: \"kubernetes.io/projected/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-kube-api-access-m4vm9\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:22:26.529299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.529270    2560 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-offline-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:22:26.529299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.529279    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:22:26.529299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.529286    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9b4b36cd-b42f-4d12-8112-9812cb74c9d5-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:22:26.722043 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.722006    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerID="3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804" exitCode=137
May 26 00:22:26.722409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.722080    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"}
May 26 00:22:26.722409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.722088    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg"
May 26 00:22:26.722409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.722112    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8476475979-znwsg" event={"ID":"9b4b36cd-b42f-4d12-8112-9812cb74c9d5","Type":"ContainerDied","Data":"5b2a2f27b3b16e1c97f409d4f66a2e27c848e37fbad535c06307d6670a275848"}
May 26 00:22:26.722409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.722128    2560 scope.go:117] "RemoveContainer" containerID="1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"
May 26 00:22:26.729841 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.729821    2560 scope.go:117] "RemoveContainer" containerID="d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"
May 26 00:22:26.737475 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.737457    2560 scope.go:117] "RemoveContainer" containerID="3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"
May 26 00:22:26.744013 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.743988    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:22:26.745127 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.745113    2560 scope.go:117] "RemoveContainer" containerID="b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"
May 26 00:22:26.749168 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.749147    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-8476475979-znwsg"]
May 26 00:22:26.752290 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.752273    2560 scope.go:117] "RemoveContainer" containerID="962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"
May 26 00:22:26.758768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.758753    2560 scope.go:117] "RemoveContainer" containerID="1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"
May 26 00:22:26.758999 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:22:26.758982    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917\": container with ID starting with 1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917 not found: ID does not exist" containerID="1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"
May 26 00:22:26.759045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759009    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917"} err="failed to get container status \"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917\": rpc error: code = NotFound desc = could not find container \"1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917\": container with ID starting with 1f01dff481447b58463d641850b6450d82bde5abe2fe426e797e38e9a8236917 not found: ID does not exist"
May 26 00:22:26.759045 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759028    2560 scope.go:117] "RemoveContainer" containerID="d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"
May 26 00:22:26.759236 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:22:26.759218    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e\": container with ID starting with d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e not found: ID does not exist" containerID="d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"
May 26 00:22:26.759298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759247    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e"} err="failed to get container status \"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e\": rpc error: code = NotFound desc = could not find container \"d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e\": container with ID starting with d36a29c5dbbdf5b8a6b4496d88542ca0956f4551fdc608379a6d7e915f2b4d1e not found: ID does not exist"
May 26 00:22:26.759298 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759270    2560 scope.go:117] "RemoveContainer" containerID="3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"
May 26 00:22:26.759518 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:22:26.759499    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804\": container with ID starting with 3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804 not found: ID does not exist" containerID="3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"
May 26 00:22:26.759594 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759525    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804"} err="failed to get container status \"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804\": rpc error: code = NotFound desc = could not find container \"3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804\": container with ID starting with 3e7fc143fd3ea453dcb93d57410026d5e01deba46d869c3a880d06dca9a37804 not found: ID does not exist"
May 26 00:22:26.759594 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759543    2560 scope.go:117] "RemoveContainer" containerID="b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"
May 26 00:22:26.759777 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:22:26.759761    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4\": container with ID starting with b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4 not found: ID does not exist" containerID="b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"
May 26 00:22:26.759839 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759784    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4"} err="failed to get container status \"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4\": rpc error: code = NotFound desc = could not find container \"b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4\": container with ID starting with b4bef4d22e7a172b5ff4730c42f3d930526a2ad2c8ce97d482155348b5e6a0b4 not found: ID does not exist"
May 26 00:22:26.759839 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.759803    2560 scope.go:117] "RemoveContainer" containerID="962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"
May 26 00:22:26.760040 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:22:26.760014    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6\": container with ID starting with 962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6 not found: ID does not exist" containerID="962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"
May 26 00:22:26.760081 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:26.760046    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6"} err="failed to get container status \"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6\": rpc error: code = NotFound desc = could not find container \"962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6\": container with ID starting with 962c8afcd908128bcd18e94dc75c26e28d834d30e69482b568231eef781500a6 not found: ID does not exist"
May 26 00:22:27.860498 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:22:27.860465    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" path="/var/lib/kubelet/pods/9b4b36cd-b42f-4d12-8112-9812cb74c9d5/volumes"
May 26 00:24:05.797952 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.797920    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798363    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798382    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798397    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="offline"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798405    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="offline"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798419    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="feast-apply"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798428    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="feast-apply"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798443    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="feast-init"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798450    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="feast-init"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798462    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" containerName="postgres"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798470    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" containerName="postgres"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798479    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798486    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798553    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="online"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798566    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="offline"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798578    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b4b36cd-b42f-4d12-8112-9812cb74c9d5" containerName="registry"
May 26 00:24:05.800197 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.798591    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e3bccd6-6986-49ba-ad42-61aa2a955c70" containerName="postgres"
May 26 00:24:05.801471 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.801451    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:24:05.804283 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.804251    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 26 00:24:05.804476 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.804353    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-wzjl9\""
May 26 00:24:05.805685 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.805665    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 26 00:24:05.819677 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.819648    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:24:05.909284 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:05.909251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89mx\" (UniqueName: \"kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx\") pod \"redis-854544c579-fpfr6\" (UID: \"d6344c00-9b78-4eda-aa20-030c45532c2b\") " pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:24:06.009683 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:06.009647    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89mx\" (UniqueName: \"kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx\") pod \"redis-854544c579-fpfr6\" (UID: \"d6344c00-9b78-4eda-aa20-030c45532c2b\") " pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:24:06.017954 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:06.017918    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89mx\" (UniqueName: \"kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx\") pod \"redis-854544c579-fpfr6\" (UID: \"d6344c00-9b78-4eda-aa20-030c45532c2b\") " pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:24:06.121066 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:06.120970    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:24:06.243104 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:06.243074    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:24:06.246215 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:24:06.246186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6344c00_9b78_4eda_aa20_030c45532c2b.slice/crio-a719f043b3e2df1208ec17130a616d4c554960ec8c96a56328b3ad6cd899bacc WatchSource:0}: Error finding container a719f043b3e2df1208ec17130a616d4c554960ec8c96a56328b3ad6cd899bacc: Status 404 returned error can't find the container with id a719f043b3e2df1208ec17130a616d4c554960ec8c96a56328b3ad6cd899bacc
May 26 00:24:06.247977 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:06.247962    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:24:07.004411 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:07.004373    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-fpfr6" event={"ID":"d6344c00-9b78-4eda-aa20-030c45532c2b","Type":"ContainerStarted","Data":"a719f043b3e2df1208ec17130a616d4c554960ec8c96a56328b3ad6cd899bacc"}
May 26 00:24:08.008981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:08.008947    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-fpfr6" event={"ID":"d6344c00-9b78-4eda-aa20-030c45532c2b","Type":"ContainerStarted","Data":"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"}
May 26 00:24:08.023571 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:08.023512    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-fpfr6" podStartSLOduration=1.496338103 podStartE2EDuration="3.023492006s" podCreationTimestamp="2026-05-26 00:24:05 +0000 UTC" firstStartedPulling="2026-05-26 00:24:06.248091519 +0000 UTC m=+984.996132715" lastFinishedPulling="2026-05-26 00:24:07.775245408 +0000 UTC m=+986.523286618" observedRunningTime="2026-05-26 00:24:08.022499471 +0000 UTC m=+986.770540689" watchObservedRunningTime="2026-05-26 00:24:08.023492006 +0000 UTC m=+986.771533225"
May 26 00:24:11.234456 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.234420    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:24:11.237759 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.237739    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.240309 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.240286    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 26 00:24:11.247546 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.247519    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:24:11.355011 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.354969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.355199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.355056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frfxr\" (UniqueName: \"kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.456089 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.456040    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frfxr\" (UniqueName: \"kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.456307 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.456186    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.456531 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.456515    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.463773 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.463743    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frfxr\" (UniqueName: \"kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr\") pod \"postgres-7c7656cc6d-sg9b2\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.547908 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.547819    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:24:11.671158 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:11.671123    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:24:11.673916 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:24:11.673888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b873efc_59ab_4487_84ca_c170451be17d.slice/crio-65a9bf098c7a63cc5fa98a3ba6871b571773f06c9387a7eb1cf3b076afb28680 WatchSource:0}: Error finding container 65a9bf098c7a63cc5fa98a3ba6871b571773f06c9387a7eb1cf3b076afb28680: Status 404 returned error can't find the container with id 65a9bf098c7a63cc5fa98a3ba6871b571773f06c9387a7eb1cf3b076afb28680
May 26 00:24:12.021359 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:12.021328    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" event={"ID":"9b873efc-59ab-4487-84ca-c170451be17d","Type":"ContainerStarted","Data":"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"}
May 26 00:24:12.021359 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:12.021364    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" event={"ID":"9b873efc-59ab-4487-84ca-c170451be17d","Type":"ContainerStarted","Data":"65a9bf098c7a63cc5fa98a3ba6871b571773f06c9387a7eb1cf3b076afb28680"}
May 26 00:24:12.035420 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:12.035372    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" podStartSLOduration=1.035359195 podStartE2EDuration="1.035359195s" podCreationTimestamp="2026-05-26 00:24:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:24:12.034719582 +0000 UTC m=+990.782760802" watchObservedRunningTime="2026-05-26 00:24:12.035359195 +0000 UTC m=+990.783400414"
May 26 00:24:16.856411 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.856372    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:24:16.861783 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.861752    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:16.864932 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.864911    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-rm9xn\""
May 26 00:24:16.865072 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.864949    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 26 00:24:16.865203 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.865188    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 26 00:24:16.865251 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.865186    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 26 00:24:16.868627 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.868585    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:24:16.900593 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.900564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:16.900765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.900647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6rl\" (UniqueName: \"kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:16.900765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.900666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:16.900765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:16.900721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.001939 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.001899    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6rl\" (UniqueName: \"kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.001939 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.001935    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.002190 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.001988    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.002190 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.002014    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.002190 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:24:17.002127    2560 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 26 00:24:17.002190 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:24:17.002185    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls podName:e0b28121-b470-41d3-9467-2d5851a111f0 nodeName:}" failed. No retries permitted until 2026-05-26 00:24:17.502167797 +0000 UTC m=+996.250208994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls") pod "feast-credit-scoring-76df95df8c-s8hg7" (UID: "e0b28121-b470-41d3-9467-2d5851a111f0") : secret "feast-credit-scoring-online-tls" not found
May 26 00:24:17.002449 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.002427    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.004644 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.004623    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.012537 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.012513    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6rl\" (UniqueName: \"kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.506738 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.506700    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.509261 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.509235    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") pod \"feast-credit-scoring-76df95df8c-s8hg7\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") " pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.773103 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.772996    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:17.902527 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:17.902496    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:24:17.906289 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:24:17.906262    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b28121_b470_41d3_9467_2d5851a111f0.slice/crio-64898ab1f7338c17df8abb5bdf23272456bcbe37f7a3308ea698a18044b08455 WatchSource:0}: Error finding container 64898ab1f7338c17df8abb5bdf23272456bcbe37f7a3308ea698a18044b08455: Status 404 returned error can't find the container with id 64898ab1f7338c17df8abb5bdf23272456bcbe37f7a3308ea698a18044b08455
May 26 00:24:18.039438 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:18.039346    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerStarted","Data":"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"}
May 26 00:24:18.039438 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:18.039389    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerStarted","Data":"64898ab1f7338c17df8abb5bdf23272456bcbe37f7a3308ea698a18044b08455"}
May 26 00:24:19.043898 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:19.043867    2560 generic.go:358] "Generic (PLEG): container finished" podID="e0b28121-b470-41d3-9467-2d5851a111f0" containerID="32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20" exitCode=0
May 26 00:24:19.044299 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:19.043953    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerDied","Data":"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"}
May 26 00:24:20.048862 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:20.048824    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerStarted","Data":"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"}
May 26 00:24:27.073227 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:27.073187    2560 generic.go:358] "Generic (PLEG): container finished" podID="e0b28121-b470-41d3-9467-2d5851a111f0" containerID="e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663" exitCode=0
May 26 00:24:27.073618 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:27.073257    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerDied","Data":"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"}
May 26 00:24:28.078757 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:28.078723    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerStarted","Data":"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"}
May 26 00:24:28.079116 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:28.078769    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerStarted","Data":"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"}
May 26 00:24:28.102798 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:28.102755    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podStartSLOduration=12.10273883 podStartE2EDuration="12.10273883s" podCreationTimestamp="2026-05-26 00:24:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:24:28.09979427 +0000 UTC m=+1006.847835489" watchObservedRunningTime="2026-05-26 00:24:28.10273883 +0000 UTC m=+1006.850780048"
May 26 00:24:29.773676 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:29.773645    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:29.773676 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:29.773687    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:29.775526 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:29.775490    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
May 26 00:24:29.775677 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:29.775527    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 26 00:24:32.773682 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:32.773625    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
May 26 00:24:33.195756 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:33.195721    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:33.196294 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:33.196265    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:33.199291 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:33.199267    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:35.773737 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:35.773695    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
May 26 00:24:37.773975 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:37.773938    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:38.774416 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:38.774387    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:38.775044 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:38.775025    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:24:42.680617 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.680566    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:24:42.687138 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.687118    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.689840 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.689810    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 26 00:24:42.689977 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.689950    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 00:24:42.690046 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.689975    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 26 00:24:42.690046 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.690029    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-vdx66\""
May 26 00:24:42.694163 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.694140    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:24:42.827062 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.827026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.827062 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.827065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.827277 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.827090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.827277 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.827229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-982pz\" (UniqueName: \"kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.927807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.927765    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.927807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.927805    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.928018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.927824    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.928018 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.927885    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-982pz\" (UniqueName: \"kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.928196 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.928165    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.930332 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.930304    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.930455 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.930432    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.935866 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.935812    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-982pz\" (UniqueName: \"kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz\") pod \"feast-driver-ranking-bfbc577d4-2bblp\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") " pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:42.997832 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:42.997801    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:43.124473 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:43.124441    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:24:43.128753 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:24:43.128723    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5aee724_2d47_4bd2_af46_516fb38baab6.slice/crio-5fe6811a4ef0ad98dbff8d79e3ed2b6e2d628781a2e5ef9fa487dc5cfb6b0137 WatchSource:0}: Error finding container 5fe6811a4ef0ad98dbff8d79e3ed2b6e2d628781a2e5ef9fa487dc5cfb6b0137: Status 404 returned error can't find the container with id 5fe6811a4ef0ad98dbff8d79e3ed2b6e2d628781a2e5ef9fa487dc5cfb6b0137
May 26 00:24:44.133482 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:44.133444    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerStarted","Data":"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"}
May 26 00:24:44.133482 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:44.133481    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerStarted","Data":"5fe6811a4ef0ad98dbff8d79e3ed2b6e2d628781a2e5ef9fa487dc5cfb6b0137"}
May 26 00:24:48.147622 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:48.147525    2560 generic.go:358] "Generic (PLEG): container finished" podID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerID="ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0" exitCode=0
May 26 00:24:48.147622 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:48.147610    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerDied","Data":"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"}
May 26 00:24:49.153165 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:49.153131    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerStarted","Data":"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"}
May 26 00:24:55.173409 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:55.173373    2560 generic.go:358] "Generic (PLEG): container finished" podID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerID="c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a" exitCode=0
May 26 00:24:55.173837 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:55.173428    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerDied","Data":"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"}
May 26 00:24:56.179845 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:56.179807    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerStarted","Data":"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"}
May 26 00:24:56.179845 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:56.179851    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerStarted","Data":"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"}
May 26 00:24:56.203106 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:56.203057    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podStartSLOduration=14.203040787 podStartE2EDuration="14.203040787s" podCreationTimestamp="2026-05-26 00:24:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:24:56.200138988 +0000 UTC m=+1034.948180414" watchObservedRunningTime="2026-05-26 00:24:56.203040787 +0000 UTC m=+1034.951082005"
May 26 00:24:57.998802 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:57.998762    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:57.999187 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:57.998819    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:24:58.000295 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:58.000262    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 26 00:24:58.000425 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:24:58.000262    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 26 00:25:00.998127 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:00.998085    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 26 00:25:01.396948 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:01.396855    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:25:01.397340 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:01.397308    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:25:01.400471 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:01.400443    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:25:02.998638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:02.998583    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:25:03.998375 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:03.998325    2560 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 26 00:25:06.998838 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:06.998807    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:25:06.999829 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:25:06.999798    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:26:21.596206 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.596171    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:26:21.596797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.596510    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry" containerID="cri-o://2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4" gracePeriod=30
May 26 00:26:21.596797 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.596634    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online" containerID="cri-o://faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460" gracePeriod=30
May 26 00:26:21.597777 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.597752    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:26:21.598025 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.597997    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry" containerID="cri-o://197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46" gracePeriod=30
May 26 00:26:21.598145 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:21.598058    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online" containerID="cri-o://38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a" gracePeriod=30
May 26 00:26:22.452041 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:22.452007    2560 generic.go:358] "Generic (PLEG): container finished" podID="e0b28121-b470-41d3-9467-2d5851a111f0" containerID="faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460" exitCode=0
May 26 00:26:22.452199 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:22.452081    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerDied","Data":"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"}
May 26 00:26:22.454060 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:22.454033    2560 generic.go:358] "Generic (PLEG): container finished" podID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerID="38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a" exitCode=0
May 26 00:26:22.454169 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:22.454085    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerDied","Data":"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"}
May 26 00:26:23.196733 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:23.196693    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 26 00:26:24.098157 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.098118    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:26:24.098344 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.098323    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" podUID="9b873efc-59ab-4487-84ca-c170451be17d" containerName="postgres" containerID="cri-o://4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd" gracePeriod=30
May 26 00:26:24.102582 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.102557    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:26:24.102766 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.102747    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-fpfr6" podUID="d6344c00-9b78-4eda-aa20-030c45532c2b" containerName="redis" containerID="cri-o://178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256" gracePeriod=30
May 26 00:26:24.354779 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.354756    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:26:24.366292 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.366274    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:26:24.461148 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.461114    2560 generic.go:358] "Generic (PLEG): container finished" podID="d6344c00-9b78-4eda-aa20-030c45532c2b" containerID="178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256" exitCode=0
May 26 00:26:24.461338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.461161    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-fpfr6"
May 26 00:26:24.461338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.461185    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-fpfr6" event={"ID":"d6344c00-9b78-4eda-aa20-030c45532c2b","Type":"ContainerDied","Data":"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"}
May 26 00:26:24.461338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.461217    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-fpfr6" event={"ID":"d6344c00-9b78-4eda-aa20-030c45532c2b","Type":"ContainerDied","Data":"a719f043b3e2df1208ec17130a616d4c554960ec8c96a56328b3ad6cd899bacc"}
May 26 00:26:24.461338 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.461236    2560 scope.go:117] "RemoveContainer" containerID="178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"
May 26 00:26:24.462288 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.462270    2560 generic.go:358] "Generic (PLEG): container finished" podID="9b873efc-59ab-4487-84ca-c170451be17d" containerID="4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd" exitCode=0
May 26 00:26:24.462365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.462309    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"
May 26 00:26:24.462365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.462355    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" event={"ID":"9b873efc-59ab-4487-84ca-c170451be17d","Type":"ContainerDied","Data":"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"}
May 26 00:26:24.462440 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.462389    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-sg9b2" event={"ID":"9b873efc-59ab-4487-84ca-c170451be17d","Type":"ContainerDied","Data":"65a9bf098c7a63cc5fa98a3ba6871b571773f06c9387a7eb1cf3b076afb28680"}
May 26 00:26:24.469083 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.469068    2560 scope.go:117] "RemoveContainer" containerID="178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"
May 26 00:26:24.469340 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:24.469314    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256\": container with ID starting with 178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256 not found: ID does not exist" containerID="178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"
May 26 00:26:24.469399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.469342    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256"} err="failed to get container status \"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256\": rpc error: code = NotFound desc = could not find container \"178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256\": container with ID starting with 178fc75609f5fdc64c505cd3336bdddd65181272f1827e3c784e0ebeead35256 not found: ID does not exist"
May 26 00:26:24.469399 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.469363    2560 scope.go:117] "RemoveContainer" containerID="4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"
May 26 00:26:24.476182 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.476164    2560 scope.go:117] "RemoveContainer" containerID="4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"
May 26 00:26:24.476424 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:24.476407    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd\": container with ID starting with 4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd not found: ID does not exist" containerID="4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"
May 26 00:26:24.476468 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.476433    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd"} err="failed to get container status \"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd\": rpc error: code = NotFound desc = could not find container \"4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd\": container with ID starting with 4a9553ed3a3006b53610179646b2afc5edf24df93b57a099705994d8154084cd not found: ID does not exist"
May 26 00:26:24.492765 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.492742    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frfxr\" (UniqueName: \"kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr\") pod \"9b873efc-59ab-4487-84ca-c170451be17d\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") "
May 26 00:26:24.492854 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.492771    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l89mx\" (UniqueName: \"kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx\") pod \"d6344c00-9b78-4eda-aa20-030c45532c2b\" (UID: \"d6344c00-9b78-4eda-aa20-030c45532c2b\") "
May 26 00:26:24.492854 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.492814    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata\") pod \"9b873efc-59ab-4487-84ca-c170451be17d\" (UID: \"9b873efc-59ab-4487-84ca-c170451be17d\") "
May 26 00:26:24.494899 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.494869    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx" (OuterVolumeSpecName: "kube-api-access-l89mx") pod "d6344c00-9b78-4eda-aa20-030c45532c2b" (UID: "d6344c00-9b78-4eda-aa20-030c45532c2b"). InnerVolumeSpecName "kube-api-access-l89mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:26:24.494899 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.494885    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr" (OuterVolumeSpecName: "kube-api-access-frfxr") pod "9b873efc-59ab-4487-84ca-c170451be17d" (UID: "9b873efc-59ab-4487-84ca-c170451be17d"). InnerVolumeSpecName "kube-api-access-frfxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:26:24.522543 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.522517    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "9b873efc-59ab-4487-84ca-c170451be17d" (UID: "9b873efc-59ab-4487-84ca-c170451be17d"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:26:24.593392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.593356    2560 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9b873efc-59ab-4487-84ca-c170451be17d-postgresdata\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:24.593392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.593387    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frfxr\" (UniqueName: \"kubernetes.io/projected/9b873efc-59ab-4487-84ca-c170451be17d-kube-api-access-frfxr\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:24.593392 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.593399    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l89mx\" (UniqueName: \"kubernetes.io/projected/d6344c00-9b78-4eda-aa20-030c45532c2b-kube-api-access-l89mx\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:24.784832 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.784804    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:26:24.788047 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.788015    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-sg9b2"]
May 26 00:26:24.797432 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.797405    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:26:24.799323 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:24.799302    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-fpfr6"]
May 26 00:26:25.860696 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:25.860663    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b873efc-59ab-4487-84ca-c170451be17d" path="/var/lib/kubelet/pods/9b873efc-59ab-4487-84ca-c170451be17d/volumes"
May 26 00:26:25.861079 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:25.860987    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6344c00-9b78-4eda-aa20-030c45532c2b" path="/var/lib/kubelet/pods/d6344c00-9b78-4eda-aa20-030c45532c2b/volumes"
May 26 00:26:31.397942 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:31.397895    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 26 00:26:33.197470 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:33.197429    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 26 00:26:41.398243 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:41.398194    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 26 00:26:43.196393 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:43.196352    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
May 26 00:26:43.196886 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:43.196485    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:26:51.397780 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:51.397737    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 26 00:26:51.398244 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:51.397872    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:26:52.266012 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.265989    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:26:52.269188 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.269170    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:26:52.330968 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.330940    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data\") pod \"e0b28121-b470-41d3-9467-2d5851a111f0\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.330980    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr6rl\" (UniqueName: \"kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl\") pod \"e0b28121-b470-41d3-9467-2d5851a111f0\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.330999    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls\") pod \"e0b28121-b470-41d3-9467-2d5851a111f0\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331019    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-982pz\" (UniqueName: \"kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz\") pod \"a5aee724-2d47-4bd2-af46-516fb38baab6\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331049    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls\") pod \"a5aee724-2d47-4bd2-af46-516fb38baab6\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331070    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls\") pod \"a5aee724-2d47-4bd2-af46-516fb38baab6\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") "
May 26 00:26:52.331124 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331117    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") pod \"e0b28121-b470-41d3-9467-2d5851a111f0\" (UID: \"e0b28121-b470-41d3-9467-2d5851a111f0\") "
May 26 00:26:52.331445 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331143    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data\") pod \"a5aee724-2d47-4bd2-af46-516fb38baab6\" (UID: \"a5aee724-2d47-4bd2-af46-516fb38baab6\") "
May 26 00:26:52.331846 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.331819    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data" (OuterVolumeSpecName: "feast-data") pod "a5aee724-2d47-4bd2-af46-516fb38baab6" (UID: "a5aee724-2d47-4bd2-af46-516fb38baab6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:26:52.333420 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333386    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz" (OuterVolumeSpecName: "kube-api-access-982pz") pod "a5aee724-2d47-4bd2-af46-516fb38baab6" (UID: "a5aee724-2d47-4bd2-af46-516fb38baab6"). InnerVolumeSpecName "kube-api-access-982pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:26:52.333558 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333527    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl" (OuterVolumeSpecName: "kube-api-access-kr6rl") pod "e0b28121-b470-41d3-9467-2d5851a111f0" (UID: "e0b28121-b470-41d3-9467-2d5851a111f0"). InnerVolumeSpecName "kube-api-access-kr6rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:26:52.333906 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333710    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a5aee724-2d47-4bd2-af46-516fb38baab6" (UID: "a5aee724-2d47-4bd2-af46-516fb38baab6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:26:52.333985 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333963    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls" (OuterVolumeSpecName: "online-tls") pod "a5aee724-2d47-4bd2-af46-516fb38baab6" (UID: "a5aee724-2d47-4bd2-af46-516fb38baab6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:26:52.334036 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333966    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls" (OuterVolumeSpecName: "online-tls") pod "e0b28121-b470-41d3-9467-2d5851a111f0" (UID: "e0b28121-b470-41d3-9467-2d5851a111f0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:26:52.334036 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.333986    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0b28121-b470-41d3-9467-2d5851a111f0" (UID: "e0b28121-b470-41d3-9467-2d5851a111f0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:26:52.340420 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.340398    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data" (OuterVolumeSpecName: "feast-data") pod "e0b28121-b470-41d3-9467-2d5851a111f0" (UID: "e0b28121-b470-41d3-9467-2d5851a111f0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:26:52.431966 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.431937    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.431966 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.431966    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a5aee724-2d47-4bd2-af46-516fb38baab6-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.431979    2560 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0b28121-b470-41d3-9467-2d5851a111f0-feast-data\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.431991    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr6rl\" (UniqueName: \"kubernetes.io/projected/e0b28121-b470-41d3-9467-2d5851a111f0-kube-api-access-kr6rl\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.432002    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0b28121-b470-41d3-9467-2d5851a111f0-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.432015    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-982pz\" (UniqueName: \"kubernetes.io/projected/a5aee724-2d47-4bd2-af46-516fb38baab6-kube-api-access-982pz\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.432026    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-registry-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.432387 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.432039    2560 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a5aee724-2d47-4bd2-af46-516fb38baab6-online-tls\") on node \"ip-10-0-131-165.ec2.internal\" DevicePath \"\""
May 26 00:26:52.542981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.542946    2560 generic.go:358] "Generic (PLEG): container finished" podID="e0b28121-b470-41d3-9467-2d5851a111f0" containerID="2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4" exitCode=137
May 26 00:26:52.543150 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.543014    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"
May 26 00:26:52.543150 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.543027    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerDied","Data":"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"}
May 26 00:26:52.543150 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.543062    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7" event={"ID":"e0b28121-b470-41d3-9467-2d5851a111f0","Type":"ContainerDied","Data":"64898ab1f7338c17df8abb5bdf23272456bcbe37f7a3308ea698a18044b08455"}
May 26 00:26:52.543150 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.543081    2560 scope.go:117] "RemoveContainer" containerID="faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"
May 26 00:26:52.545167 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.545099    2560 generic.go:358] "Generic (PLEG): container finished" podID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerID="197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46" exitCode=137
May 26 00:26:52.545167 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.545153    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"
May 26 00:26:52.545344 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.545170    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerDied","Data":"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"}
May 26 00:26:52.545344 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.545199    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp" event={"ID":"a5aee724-2d47-4bd2-af46-516fb38baab6","Type":"ContainerDied","Data":"5fe6811a4ef0ad98dbff8d79e3ed2b6e2d628781a2e5ef9fa487dc5cfb6b0137"}
May 26 00:26:52.551807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.551789    2560 scope.go:117] "RemoveContainer" containerID="2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"
May 26 00:26:52.560052 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.560026    2560 scope.go:117] "RemoveContainer" containerID="e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"
May 26 00:26:52.567235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.567218    2560 scope.go:117] "RemoveContainer" containerID="32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"
May 26 00:26:52.568030 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.568010    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:26:52.574581 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.574552    2560 scope.go:117] "RemoveContainer" containerID="faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"
May 26 00:26:52.574909 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.574889    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460\": container with ID starting with faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460 not found: ID does not exist" containerID="faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"
May 26 00:26:52.574982 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.574916    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460"} err="failed to get container status \"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460\": rpc error: code = NotFound desc = could not find container \"faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460\": container with ID starting with faebb8eeadd8e6e4b6fc2ba90a180bd98a96d9906d755b440697525371243460 not found: ID does not exist"
May 26 00:26:52.574982 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.574937    2560 scope.go:117] "RemoveContainer" containerID="2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"
May 26 00:26:52.575205 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.575183    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4\": container with ID starting with 2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4 not found: ID does not exist" containerID="2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"
May 26 00:26:52.575293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575213    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4"} err="failed to get container status \"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4\": rpc error: code = NotFound desc = could not find container \"2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4\": container with ID starting with 2d49c2bb465520fbff70861bc84cd47e8540a917fb95078e6d1154750c64d4f4 not found: ID does not exist"
May 26 00:26:52.575293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575229    2560 scope.go:117] "RemoveContainer" containerID="e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"
May 26 00:26:52.575293 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575196    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-76df95df8c-s8hg7"]
May 26 00:26:52.575460 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.575442    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663\": container with ID starting with e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663 not found: ID does not exist" containerID="e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"
May 26 00:26:52.575500 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575468    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663"} err="failed to get container status \"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663\": rpc error: code = NotFound desc = could not find container \"e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663\": container with ID starting with e9233ed3a65c9b011fe3451511768aa07bda74ca7f113c0119237039e93de663 not found: ID does not exist"
May 26 00:26:52.575500 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575485    2560 scope.go:117] "RemoveContainer" containerID="32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"
May 26 00:26:52.575744 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.575727    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20\": container with ID starting with 32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20 not found: ID does not exist" containerID="32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"
May 26 00:26:52.575807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575756    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20"} err="failed to get container status \"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20\": rpc error: code = NotFound desc = could not find container \"32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20\": container with ID starting with 32a3037257d87ae3cfc799a8f1ac2d5360fe335f24aeec9f20644247364e3c20 not found: ID does not exist"
May 26 00:26:52.575807 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.575771    2560 scope.go:117] "RemoveContainer" containerID="38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"
May 26 00:26:52.582666 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.582652    2560 scope.go:117] "RemoveContainer" containerID="197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"
May 26 00:26:52.587513 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.587495    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:26:52.590502 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.590484    2560 scope.go:117] "RemoveContainer" containerID="c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"
May 26 00:26:52.593095 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.593074    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-bfbc577d4-2bblp"]
May 26 00:26:52.597365 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.597350    2560 scope.go:117] "RemoveContainer" containerID="ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"
May 26 00:26:52.604180 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604012    2560 scope.go:117] "RemoveContainer" containerID="38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"
May 26 00:26:52.604302 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.604285    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a\": container with ID starting with 38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a not found: ID does not exist" containerID="38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"
May 26 00:26:52.604347 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604308    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a"} err="failed to get container status \"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a\": rpc error: code = NotFound desc = could not find container \"38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a\": container with ID starting with 38257edbfcf1a8842e5a18db2182d21cb03d7de9047c27c42aec076981a5bd6a not found: ID does not exist"
May 26 00:26:52.604347 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604325    2560 scope.go:117] "RemoveContainer" containerID="197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"
May 26 00:26:52.604543 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.604527    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46\": container with ID starting with 197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46 not found: ID does not exist" containerID="197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"
May 26 00:26:52.604629 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604552    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46"} err="failed to get container status \"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46\": rpc error: code = NotFound desc = could not find container \"197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46\": container with ID starting with 197fa504caceda9b54b421dece668dcfe731899d4516cc186edf24972cc14f46 not found: ID does not exist"
May 26 00:26:52.604629 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604574    2560 scope.go:117] "RemoveContainer" containerID="c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"
May 26 00:26:52.604814 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.604793    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a\": container with ID starting with c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a not found: ID does not exist" containerID="c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"
May 26 00:26:52.604864 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604820    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a"} err="failed to get container status \"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a\": rpc error: code = NotFound desc = could not find container \"c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a\": container with ID starting with c7a798623e2fee1e665a59c2df60855664d8fe294155982616b8cdc48003436a not found: ID does not exist"
May 26 00:26:52.604864 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.604834    2560 scope.go:117] "RemoveContainer" containerID="ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"
May 26 00:26:52.605029 ip-10-0-131-165 kubenswrapper[2560]: E0526 00:26:52.605013    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0\": container with ID starting with ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0 not found: ID does not exist" containerID="ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"
May 26 00:26:52.605081 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:52.605034    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0"} err="failed to get container status \"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0\": rpc error: code = NotFound desc = could not find container \"ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0\": container with ID starting with ac5f9382029246aaa334ce6ecc7a054cd4557679239dd5455acc55a0ae903be0 not found: ID does not exist"
May 26 00:26:53.860991 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:53.860957    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" path="/var/lib/kubelet/pods/a5aee724-2d47-4bd2-af46-516fb38baab6/volumes"
May 26 00:26:53.861464 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:26:53.861451    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" path="/var/lib/kubelet/pods/e0b28121-b470-41d3-9467-2d5851a111f0/volumes"
May 26 00:37:40.584770 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:40.584737    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5zkq4_dc68c807-3cfb-41d3-a9a7-73e3ea450376/global-pull-secret-syncer/0.log"
May 26 00:37:40.755254 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:40.755225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vp8mw_77ef692d-47f8-45fb-8e4f-a205a8ff6615/konnectivity-agent/0.log"
May 26 00:37:40.801836 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:40.801806    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-165.ec2.internal_ccc3e4b1136a584073ab8921e325dd50/haproxy/0.log"
May 26 00:37:44.249401 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.249365    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-8gb7w_4dceeebf-1f0d-48a1-86b2-60425b634abc/cluster-monitoring-operator/0.log"
May 26 00:37:44.273962 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.273929    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-x7pxj_f895dd7a-29c4-4c4a-b896-2daf5f60b0ab/kube-state-metrics/0.log"
May 26 00:37:44.291003 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.290973    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-x7pxj_f895dd7a-29c4-4c4a-b896-2daf5f60b0ab/kube-rbac-proxy-main/0.log"
May 26 00:37:44.310785 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.310752    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-x7pxj_f895dd7a-29c4-4c4a-b896-2daf5f60b0ab/kube-rbac-proxy-self/0.log"
May 26 00:37:44.341950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.341906    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86585f5fff-f8jgn_68d71a6b-3a89-4e6b-9803-6085967a815f/metrics-server/0.log"
May 26 00:37:44.363274 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.363251    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-vsqnc_05a8717b-0d14-45dc-867b-9ef6b378bcb4/monitoring-plugin/0.log"
May 26 00:37:44.464235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.464208    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hk2t_fe7d6cbb-b085-47f1-9618-0d25fb05747c/node-exporter/0.log"
May 26 00:37:44.481471 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.481398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hk2t_fe7d6cbb-b085-47f1-9618-0d25fb05747c/kube-rbac-proxy/0.log"
May 26 00:37:44.499244 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.499220    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hk2t_fe7d6cbb-b085-47f1-9618-0d25fb05747c/init-textfile/0.log"
May 26 00:37:44.590688 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.590656    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-qhrnd_55379963-6923-4568-8c4d-86724a7fe9e9/kube-rbac-proxy-main/0.log"
May 26 00:37:44.610923 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.610881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-qhrnd_55379963-6923-4568-8c4d-86724a7fe9e9/kube-rbac-proxy-self/0.log"
May 26 00:37:44.628925 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.628884    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-qhrnd_55379963-6923-4568-8c4d-86724a7fe9e9/openshift-state-metrics/0.log"
May 26 00:37:44.662149 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.662118    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/prometheus/0.log"
May 26 00:37:44.679142 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.679120    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/config-reloader/0.log"
May 26 00:37:44.697854 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.697831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/thanos-sidecar/0.log"
May 26 00:37:44.717590 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.717561    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/kube-rbac-proxy-web/0.log"
May 26 00:37:44.736251 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.736180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/kube-rbac-proxy/0.log"
May 26 00:37:44.755895 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.755876    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/kube-rbac-proxy-thanos/0.log"
May 26 00:37:44.778257 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.778236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e9b0c60a-cf7b-4b69-9be7-b5a1dd19cc24/init-config-reloader/0.log"
May 26 00:37:44.805319 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.805291    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-8zmr6_334e0fc2-8773-44fa-8c91-21f991e134f1/prometheus-operator/0.log"
May 26 00:37:44.823035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.823015    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-8zmr6_334e0fc2-8773-44fa-8c91-21f991e134f1/kube-rbac-proxy/0.log"
May 26 00:37:44.849617 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:44.849583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-xl2pn_ed615e9e-f1bc-4644-9397-408051fbf224/prometheus-operator-admission-webhook/0.log"
May 26 00:37:47.056252 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056222    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"]
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056548    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056569    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="feast-apply"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056575    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="feast-apply"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056590    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6344c00-9b78-4eda-aa20-030c45532c2b" containerName="redis"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056610    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6344c00-9b78-4eda-aa20-030c45532c2b" containerName="redis"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056616    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="feast-init"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056622    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="feast-init"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056635    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online"
May 26 00:37:47.056638 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056640    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056647    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b873efc-59ab-4487-84ca-c170451be17d" containerName="postgres"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056658    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b873efc-59ab-4487-84ca-c170451be17d" containerName="postgres"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056664    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="feast-init"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056669    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="feast-init"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056677    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056684    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056692    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056699    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056709    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="feast-apply"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056715    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="feast-apply"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056791    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6344c00-9b78-4eda-aa20-030c45532c2b" containerName="redis"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056800    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="online"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056807    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="registry"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056813    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b873efc-59ab-4487-84ca-c170451be17d" containerName="postgres"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056819    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5aee724-2d47-4bd2-af46-516fb38baab6" containerName="registry"
May 26 00:37:47.056950 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.056826    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0b28121-b470-41d3-9467-2d5851a111f0" containerName="online"
May 26 00:37:47.058780 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.058765    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.061825 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.061801    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55vjt\"/\"openshift-service-ca.crt\""
May 26 00:37:47.063156 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.063132    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55vjt\"/\"kube-root-ca.crt\""
May 26 00:37:47.063289 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.063144    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-55vjt\"/\"default-dockercfg-4868d\""
May 26 00:37:47.066170 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.066146    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"]
May 26 00:37:47.174580 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.174548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-proc\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.174768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.174640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-podres\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.174768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.174667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-sys\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.174768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.174687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-lib-modules\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.174768 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.174711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnwvb\" (UniqueName: \"kubernetes.io/projected/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-kube-api-access-dnwvb\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.200039 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.199998    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-mf7c2_e0946040-a609-4bf4-af7c-44633ba405ab/volume-data-source-validator/0.log"
May 26 00:37:47.275855 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275824    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-podres\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275864    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-sys\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275893    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-lib-modules\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnwvb\" (UniqueName: \"kubernetes.io/projected/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-kube-api-access-dnwvb\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275962    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-proc\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.275972    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-sys\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276035 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.276016    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-lib-modules\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276335 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.276018    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-podres\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.276335 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.276070    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-proc\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.283726 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.283701    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnwvb\" (UniqueName: \"kubernetes.io/projected/51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5-kube-api-access-dnwvb\") pod \"perf-node-gather-daemonset-r4t22\" (UID: \"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.369534 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.369434    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:47.494434 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.494409    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"]
May 26 00:37:47.496980 ip-10-0-131-165 kubenswrapper[2560]: W0526 00:37:47.496954    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51ab8f50_7a26_4e4f_8f7c_e8fd78086ff5.slice/crio-8ec0216cbac95d3b017b05732b58fd15843d0ce4dd975500a33db9aa6c1477ac WatchSource:0}: Error finding container 8ec0216cbac95d3b017b05732b58fd15843d0ce4dd975500a33db9aa6c1477ac: Status 404 returned error can't find the container with id 8ec0216cbac95d3b017b05732b58fd15843d0ce4dd975500a33db9aa6c1477ac
May 26 00:37:47.498477 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.498460    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:37:47.786235 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.786208    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4rjj5_013c46bf-8592-4a5a-80da-6d88abe8b20a/dns/0.log"
May 26 00:37:47.806167 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.806134    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4rjj5_013c46bf-8592-4a5a-80da-6d88abe8b20a/kube-rbac-proxy/0.log"
May 26 00:37:47.922743 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:47.922714    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dqrng_354a28fe-146a-49ac-93a3-a43ac8603acb/dns-node-resolver/0.log"
May 26 00:37:48.367719 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:48.367688    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z65cf_816dbe6c-385b-4bfe-bcbd-8fb1d78f02d9/node-ca/0.log"
May 26 00:37:48.400368 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:48.400334    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22" event={"ID":"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5","Type":"ContainerStarted","Data":"89b1598a78f1e4d05a10a70718d7da3f6a6855b4fe48d7fc5dbfe04bb01fca44"}
May 26 00:37:48.400517 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:48.400374    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22" event={"ID":"51ab8f50-7a26-4e4f-8f7c-e8fd78086ff5","Type":"ContainerStarted","Data":"8ec0216cbac95d3b017b05732b58fd15843d0ce4dd975500a33db9aa6c1477ac"}
May 26 00:37:48.400517 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:48.400406    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:48.416883 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:48.416835    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22" podStartSLOduration=1.416820481 podStartE2EDuration="1.416820481s" podCreationTimestamp="2026-05-26 00:37:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:37:48.41539951 +0000 UTC m=+1807.163440729" watchObservedRunningTime="2026-05-26 00:37:48.416820481 +0000 UTC m=+1807.164861694"
May 26 00:37:49.320029 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:49.319990    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zlq6_a4c72b19-dbf7-4a99-825a-b915659541fc/serve-healthcheck-canary/0.log"
May 26 00:37:49.704042 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:49.704004    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhdnf_eb63beaf-2737-48bd-8968-0a11a4e6d0fe/kube-rbac-proxy/0.log"
May 26 00:37:49.723094 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:49.723065    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhdnf_eb63beaf-2737-48bd-8968-0a11a4e6d0fe/exporter/0.log"
May 26 00:37:49.741015 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:49.740988    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rhdnf_eb63beaf-2737-48bd-8968-0a11a4e6d0fe/extractor/0.log"
May 26 00:37:53.626994 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:53.626961    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-js7b9_821c70fd-0ac7-47b7-ad3a-0299f8fab55e/migrator/0.log"
May 26 00:37:53.643649 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:53.643620    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-js7b9_821c70fd-0ac7-47b7-ad3a-0299f8fab55e/graceful-termination/0.log"
May 26 00:37:54.412658 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.412634    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-r4t22"
May 26 00:37:54.914592 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.914568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/kube-multus-additional-cni-plugins/0.log"
May 26 00:37:54.935821 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.935793    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/egress-router-binary-copy/0.log"
May 26 00:37:54.952132 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.952112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/cni-plugins/0.log"
May 26 00:37:54.968815 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.968790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/bond-cni-plugin/0.log"
May 26 00:37:54.985284 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:54.985260    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/routeoverride-cni/0.log"
May 26 00:37:55.002241 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:55.002223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/whereabouts-cni-bincopy/0.log"
May 26 00:37:55.020801 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:55.020781    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tjptx_e7faca6d-4076-49b5-925e-9e8e7f92479e/whereabouts-cni/0.log"
May 26 00:37:55.188981 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:55.188898    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w8hg5_d0f151e6-7404-42de-80ea-4fd7752431ce/kube-multus/0.log"
May 26 00:37:55.328851 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:55.328818    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k4tkk_3b743cdc-f2ac-44ff-b936-adad789e96b2/network-metrics-daemon/0.log"
May 26 00:37:55.344663 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:55.344639    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k4tkk_3b743cdc-f2ac-44ff-b936-adad789e96b2/kube-rbac-proxy/0.log"
May 26 00:37:56.490666 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.490639    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/ovn-controller/0.log"
May 26 00:37:56.521134 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.521112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/ovn-acl-logging/0.log"
May 26 00:37:56.538543 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.538522    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/kube-rbac-proxy-node/0.log"
May 26 00:37:56.557102 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.557082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/kube-rbac-proxy-ovn-metrics/0.log"
May 26 00:37:56.574721 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.574703    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/northd/0.log"
May 26 00:37:56.594304 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.594273    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/nbdb/0.log"
May 26 00:37:56.611979 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.611959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/sbdb/0.log"
May 26 00:37:56.786006 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:56.785922    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r6gb6_23edeb57-7426-44a3-8605-79309b6d0ab4/ovnkube-controller/0.log"
May 26 00:37:57.885267 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:57.885182    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cktzs_8d24d6c7-9212-49b0-8a14-0fa836285fcf/network-check-target-container/0.log"
May 26 00:37:58.770238 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:58.770154    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xz2m9_9232be98-f6ed-4113-a5e7-8285088ee9e5/iptables-alerter/0.log"
May 26 00:37:59.414114 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:37:59.414083    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mpfvr_1df9572f-515c-4263-801e-f16db97510f9/tuned/0.log"
May 26 00:38:00.925986 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:00.925959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-pdpv5_1816a094-6864-43a4-89cd-c9e486fa21d2/cluster-samples-operator/0.log"
May 26 00:38:00.939377 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:00.939346    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-pdpv5_1816a094-6864-43a4-89cd-c9e486fa21d2/cluster-samples-operator-watch/0.log"
May 26 00:38:01.819395 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:01.819355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sbhd2_c40378ac-aae1-4652-a23f-7271dc560aad/service-ca-operator/1.log"
May 26 00:38:01.821168 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:01.821146    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sbhd2_c40378ac-aae1-4652-a23f-7271dc560aad/service-ca-operator/0.log"
May 26 00:38:02.526461 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:02.526434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jcx8v_496bd1dd-899a-4375-ade8-705209198b1c/csi-driver/0.log"
May 26 00:38:02.546034 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:02.545985    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jcx8v_496bd1dd-899a-4375-ade8-705209198b1c/csi-node-driver-registrar/0.log"
May 26 00:38:02.565207 ip-10-0-131-165 kubenswrapper[2560]: I0526 00:38:02.565185    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-jcx8v_496bd1dd-899a-4375-ade8-705209198b1c/csi-liveness-probe/0.log"