Jul 01 17:16:16.916725 ip-10-0-142-81 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 17:16:17.316449 ip-10-0-142-81 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 17:16:17.316449 ip-10-0-142-81 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 17:16:17.316449 ip-10-0-142-81 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 17:16:17.316449 ip-10-0-142-81 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 17:16:17.316449 ip-10-0-142-81 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 17:16:17.317504 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.317406    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 17:16:17.322862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322847    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.322862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322863    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322866    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322869    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322872    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322875    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322877    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322881    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322884    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322886    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322889    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322892    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322894    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322896    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322899    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322901    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322903    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322907    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322911    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322914    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.322941 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322916    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322919    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322924    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322927    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322929    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322932    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322934    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322937    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322941    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322944    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322947    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322950    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322953    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322956    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322958    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322960    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322963    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322965    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322968    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.323382 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322970    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322972    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322974    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322977    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322979    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322982    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322984    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322986    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322988    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322991    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322993    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322995    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.322997    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323000    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323003    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323006    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323009    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323012    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323014    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323017    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.323843 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323019    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323021    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323024    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323026    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323028    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323030    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323033    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323035    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323037    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323039    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323042    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323044    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323046    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323050    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323053    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323056    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323059    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323061    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323064    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323066    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.324329 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323069    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323072    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323075    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323078    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323080    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323083    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323085    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323088    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323091    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323093    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323096    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323098    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323101    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323103    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323105    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323108    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323110    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323112    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323115    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323117    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.324799 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323808    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323815    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323818    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323821    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323824    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323826    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323829    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323832    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323834    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323836    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323839    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323841    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323844    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323848    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323853    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323857    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323861    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323864    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323866    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.325300 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323870    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323872    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323875    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323877    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323880    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323882    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323885    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323887    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323890    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323893    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323895    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323898    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323900    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323902    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323905    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323907    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323910    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323912    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323914    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323917    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.325764 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323919    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323921    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323924    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323926    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323928    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323930    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323933    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323935    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323939    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323941    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323943    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323945    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323948    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323951    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323953    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323955    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323958    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323960    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323962    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323965    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.326259 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323967    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323969    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323972    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323975    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323977    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323979    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323982    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323984    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323986    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323989    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323991    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323993    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323996    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.323998    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324001    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324004    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324006    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324008    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324011    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324013    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.326750 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324017    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324020    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324022    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324024    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324027    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324029    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324031    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324034    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324036    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324038    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324041    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324043    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324045    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324048    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324051    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324054    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324057    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324060    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324063    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.327218 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324065    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324437    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324442    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324445    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324448    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324450    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324453    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324455    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324458    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324461    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324464    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324467    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324469    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324487    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324490    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324492    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324495    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324498    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324501    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324503    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.327700 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324506    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324508    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324510    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324513    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324516    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324519    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324521    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324523    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324526    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324528    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324530    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324533    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324535    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324538    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324540    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324542    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324545    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324547    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324552    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324555    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.328201 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324558    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324560    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324563    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324566    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324568    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324572    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324575    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324579    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324582    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324585    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324587    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324590    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324592    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324595    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324598    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324600    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324602    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324605    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324607    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.328692 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324610    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324613    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324615    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324617    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324619    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324622    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324628    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324631    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324634    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324636    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324639    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324642    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324644    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324647    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324649    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324651    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324654    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324656    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324658    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324661    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.329152 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324663    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324666    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324668    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324670    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324672    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324675    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324677    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324680    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324682    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324684    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324686    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324689    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324691    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324694    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324696    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324698    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324700    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324703    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324706    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324709    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.329623 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.324711    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324778    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324791    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324797    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324801    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324804    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324808    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324812    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324816    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324819    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324822    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324825    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324828    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324830    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324834    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324836    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324839    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324841    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324844    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324848    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324851    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324854    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324857    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324860    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 17:16:17.330086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324863    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324866    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324868    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324871    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324874    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324877    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324881    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324884    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324887    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324890    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324893    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324896    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324899    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324901    2582 flags.go:64] FLAG: --enable-server="true"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324904    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324908    2582 flags.go:64] FLAG: --event-burst="100"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324910    2582 flags.go:64] FLAG: --event-qps="50"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324913    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324916    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324918    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324922    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324924    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324927    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324930    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324933    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 17:16:17.330657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324935    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324938    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324940    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324943    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324945    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324948    2582 flags.go:64] FLAG: --feature-gates=""
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324951    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324954    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324956    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324959    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324962    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324965    2582 flags.go:64] FLAG: --help="false"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324967    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324971    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324974    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324976    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324979    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324983    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324986    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324988    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324991    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324994    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324996    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.324999    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 17:16:17.331277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325002    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325004    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325007    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325009    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325012    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325014    2582 flags.go:64] FLAG: --lock-file=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325017    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325020    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325023    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325028    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325030    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325032    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325035    2582 flags.go:64] FLAG: --logging-format="text"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325037    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325040    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325043    2582 flags.go:64] FLAG: --manifest-url=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325045    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325049    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325052    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325056    2582 flags.go:64] FLAG: --max-pods="110"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325059    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325062    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325065    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325067    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325070    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 17:16:17.331867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325073    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325076    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325082    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325085    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325087    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325090    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325093    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325098    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325100    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325103    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325106    2582 flags.go:64] FLAG: --port="10250"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325108    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325111    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08c8aad0f401bdaf7"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325114    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325116    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325122    2582 flags.go:64] FLAG: --register-node="true"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325124    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325128    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325130    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325133    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325135    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325138    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325141    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325143    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325146    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 17:16:17.332462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325148    2582 flags.go:64] FLAG: --runonce="false"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325151    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325154    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325156    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325161    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325164    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325167    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325170    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325172    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325175    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325178    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325180    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325183    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325185    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325188    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325190    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325195    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325197    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325200    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325204    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325206    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325209    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325211    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325214    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325216    2582 flags.go:64] FLAG: --v="2"
Jul 01 17:16:17.333059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325220    2582 flags.go:64] FLAG: --version="false"
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325223    2582 flags.go:64] FLAG: --vmodule=""
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325226    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.325229    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325328    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325332    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325335    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325338    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325340    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325343    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325345    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325350    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325352    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325354    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325358    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325361    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325363    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325366    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325368    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325371    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325373    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.333664 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325376    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325379    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325381    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325384    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325386    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325388    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325390    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325393    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325395    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325399    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325403    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325405    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325408    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325411    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325413    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325416    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325418    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325420    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325423    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.334158 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325425    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325427    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325430    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325433    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325435    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325438    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325442    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325444    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325446    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325449    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325451    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325454    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325456    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325458    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325461    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325463    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325466    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325468    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325484    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325487    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.334650 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325489    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325492    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325494    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325497    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325500    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325503    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325505    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325508    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325510    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325513    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325515    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325518    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325520    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325523    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325525    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325531    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325534    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325537    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325540    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.335119 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325543    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325545    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325548    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325550    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325553    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325556    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325559    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325561    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325563    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325566    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325568    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325571    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325573    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325575    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325577    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325580    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325582    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325585    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325587    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325590    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.335586 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325593    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325595    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325598    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.325602    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.326343    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.332649    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.332663    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.332679    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.332687    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332738    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332742    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332745    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332748    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332751    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.336057 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332754    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332757    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332759    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332762    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332765    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332768    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332770    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332773    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332775    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332779    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332782    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332785    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332788    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332791    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332794    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332797    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332799    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332802    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332804    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.336405 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332807    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332809    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332813    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332817    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332820    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332823    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332826    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332828    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332831    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332833    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332836    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332838    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332840    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332843    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332845    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332848    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332850    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332853    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332855    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.336859 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332858    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332860    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332863    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332865    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332868    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332870    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332872    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332875    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332877    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332879    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332882    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332884    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332887    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332889    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332891    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332894    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332896    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332899    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332902    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332905    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.337301 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332907    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332910    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332912    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332916    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332919    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332922    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332924    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332927    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332929    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332932    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332934    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332936    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332939    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332941    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332944    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332946    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332949    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332951    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332953    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.337862 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332956    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332958    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332960    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332963    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332965    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332967    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332969    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332972    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332974    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332977    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332980    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332983    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332985    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332988    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332990    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332993    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.338338 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.332995    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.333000    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333106    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333110    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333113    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333116    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333118    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333121    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333125    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333129    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333132    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333134    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333136    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333139    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 17:16:17.338725 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333141    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333143    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333146    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333148    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333150    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333152    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333155    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333157    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333159    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333162    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333164    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333166    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333169    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333171    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333174    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333176    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333179    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333181    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333184    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 17:16:17.339055 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333187    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333190    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333193    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333196    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333199    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333201    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333204    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333206    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333209    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333212    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333215    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333217    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333220    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333222    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333224    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333227    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333229    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333231    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333234    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 17:16:17.339519 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333236    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333238    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333241    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333243    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333246    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333248    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333250    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333252    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333255    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333257    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333260    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333263    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333265    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333267    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333270    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333272    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333274    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333276    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333279    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333281    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 17:16:17.339979 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333283    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333285    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333288    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333290    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333292    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333294    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333297    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333299    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333301    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333303    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333306    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333308    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333310    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333313    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333315    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333317    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333320    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333322    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333324    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333326    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 17:16:17.340727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333329    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333331    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333334    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333336    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333339    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333341    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333343    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333345    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:17.333348    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.333353    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.333443    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.335255    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.337033    2582 server.go:1019] "Starting client certificate rotation"
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.337130    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 17:16:17.341266 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.337164    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 17:16:17.341622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.339236    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 17:16:17.341622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.340310    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 17:16:17.353143 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.353126    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 01 17:16:17.358182 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.358165    2582 log.go:25] "Validated CRI v1 image API"
Jul 01 17:16:17.359082 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.359067    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 17:16:17.362362 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.362346    2582 fs.go:135] Filesystem UUIDs: map[5c1e6d4a-4813-4d91-8113-17c091174654:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d802ffe6-c201-45ae-a3f3-6f032d757890:/dev/nvme0n1p4]
Jul 01 17:16:17.362435 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.362363    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 17:16:17.368018 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.367918    2582 manager.go:216] Machine: {Timestamp:2026-07-01 17:16:17.366604184 +0000 UTC m=+0.330167867 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3206212 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec216a3c719b6b640f84cef7a54daee6 SystemUUID:ec216a3c-719b-6b64-0f84-cef7a54daee6 BootID:bf831d86-efcc-4d34-b4bd-fc04e8892311 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:1d:09:75:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:1d:09:75:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:d9:b8:95:ea:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 17:16:17.368018 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.368014    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 17:16:17.368126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.368080    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 17:16:17.372027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.371997    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 17:16:17.372166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.372029    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-81.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 17:16:17.372700 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.372690    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 17:16:17.372739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.372702    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 17:16:17.372739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.372710    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 17:16:17.373045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.373023    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 17:16:17.374187 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.374176    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 17:16:17.374985 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.374976    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 17:16:17.377814 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377802    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 17:16:17.377926 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377917    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 17:16:17.377965 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377943    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 17:16:17.377965 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377952    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 17:16:17.377965 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377963    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 17:16:17.378086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377977    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 01 17:16:17.378086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.377985    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 17:16:17.378346 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.378333    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 17:16:17.378382 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.378359    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 17:16:17.381274 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.381256    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 17:16:17.382716 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.382702    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 17:16:17.382845 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.382731    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 17:16:17.384107 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384093    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 17:16:17.384163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384114    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 17:16:17.384163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384121    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 17:16:17.384163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384126    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 17:16:17.384163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384134    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 17:16:17.384163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384159    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384168    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384173    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384179    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384184    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384195    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 17:16:17.384290 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.384200    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 17:16:17.385967 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.385953    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 17:16:17.385967 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.385965    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 17:16:17.388983 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.388964    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-81.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 17:16:17.389055 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.388983    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 17:16:17.389112 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.389089    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 17:16:17.389212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.389200    2582 server.go:1268] "Started kubelet"
Jul 01 17:16:17.389294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.389274    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 17:16:17.389491 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.389398    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 17:16:17.389652 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.389581    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 17:16:17.390169 ip-10-0-142-81 systemd[1]: Started Kubernetes Kubelet.
Jul 01 17:16:17.390700 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.390679    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 17:16:17.395198 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.395165    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 17:16:17.395783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.395766    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 17:16:17.397947 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.396891    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-81.ec2.internal.18be39e97806d85d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-81.ec2.internal,UID:ip-10-0-142-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-81.ec2.internal,},FirstTimestamp:2026-07-01 17:16:17.389172829 +0000 UTC m=+0.352736512,LastTimestamp:2026-07-01 17:16:17.389172829 +0000 UTC m=+0.352736512,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-81.ec2.internal,}"
Jul 01 17:16:17.399046 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399026    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 17:16:17.399142 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399043    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 17:16:17.399142 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399085    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8nnt"
Jul 01 17:16:17.399142 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.399115    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:17.399648 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399631    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 17:16:17.399648 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399651    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 17:16:17.399783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399635    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 17:16:17.399783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399780    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 17:16:17.399878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399787    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 17:16:17.399943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399928    2582 factory.go:55] Registering systemd factory
Jul 01 17:16:17.399971 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.399947    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 01 17:16:17.400188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400161    2582 factory.go:153] Registering CRI-O factory
Jul 01 17:16:17.400188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400181    2582 factory.go:223] Registration of the crio container factory successfully
Jul 01 17:16:17.400293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400222    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 17:16:17.400293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400239    2582 factory.go:103] Registering Raw factory
Jul 01 17:16:17.400293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400253    2582 manager.go:1196] Started watching for new ooms in manager
Jul 01 17:16:17.400635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.400612    2582 manager.go:349] Starting recovery of all containers
Jul 01 17:16:17.406760 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.406731    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8nnt"
Jul 01 17:16:17.409661 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.409645    2582 manager.go:354] Recovery completed
Jul 01 17:16:17.410920 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.410898    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 01 17:16:17.410920 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.410890    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 01 17:16:17.413927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.413916    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.415642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.415607    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.415642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.415630    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.415642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.415638    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.416135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.416121    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 17:16:17.416135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.416128    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.416135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.416133    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 17:16:17.416273 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.416147    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 17:16:17.416998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.416985    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.417060 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.417049    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.417104 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.417066    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.417213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.417199    2582 policy_none.go:49] "None policy: Start"
Jul 01 17:16:17.417247 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.417221    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 17:16:17.417247 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.417231    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 17:16:17.418192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.418181    2582 policy_none.go:47] "Start"
Jul 01 17:16:17.456020 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456001    2582 manager.go:337] "Starting Device Plugin manager"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.456037    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456049    2582 server.go:87] "Starting device plugin registration server"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456257    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456266    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456349    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456469    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.456525    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.457054    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.457104    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.461967    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.463224    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.463255    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.463272    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.463302    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 01 17:16:17.466977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.464672    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:17.557129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.557109    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.558070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.558054    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.558135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.558082    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.558135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.558091    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.558135 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.558112    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.563718 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.563703    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.563762 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.563734    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-81.ec2.internal\": node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:17.563807 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.563702    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"]
Jul 01 17:16:17.563855 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.563846    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.565044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.565031    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.565102 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.565056    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.565102 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.565065    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.566207 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566195    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.566320 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.566355 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566340    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.566939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566901    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.566939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566927    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.566939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566936    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.567054 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566902    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.567054 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.566998    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.567054 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.567014    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.568053 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.568039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.568092 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.568069    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 17:16:17.568706 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.568693    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 17:16:17.568775 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.568715    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 17:16:17.568775 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.568730    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeHasSufficientPID"
Jul 01 17:16:17.575095 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.575083    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:17.594038 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.594017    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-81.ec2.internal\" not found" node="ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.598197 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.598185    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-81.ec2.internal\" not found" node="ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.599973 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.599958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.600034 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.599982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.600034 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.599998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c6f01bf881842f56beb7f6d6350515a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-81.ec2.internal\" (UID: \"1c6f01bf881842f56beb7f6d6350515a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.675813 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.675795    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:17.700127 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.700192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.700192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c6f01bf881842f56beb7f6d6350515a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-81.ec2.internal\" (UID: \"1c6f01bf881842f56beb7f6d6350515a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.700192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.700192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700184    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c6f01bf881842f56beb7f6d6350515a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-81.ec2.internal\" (UID: \"1c6f01bf881842f56beb7f6d6350515a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.700335 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:17.700228    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa148af326afdd0a2c33ab39aa85ac2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal\" (UID: \"2aa148af326afdd0a2c33ab39aa85ac2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:17.776600 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:17.776575    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.067209 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.067060    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.087348 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.087331    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:19.091366 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.091353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:19.167588 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.167557    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.268019 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.267999    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.368489 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.368437    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.456738 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.456722    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:19.468520 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.468492    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.471229 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.471213    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:19.526545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.525961    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 17:16:19.526545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.526107    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 17:16:19.526545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.526187    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 17:16:19.526545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.526221    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 17:16:19.568572 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:19.568542    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-81.ec2.internal\" not found"
Jul 01 17:16:19.568793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.568778    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:19.581937 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:19.581913    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6f01bf881842f56beb7f6d6350515a.slice/crio-4971b06c194e08b0025cf59f7368625757851754fc10d547ce144851ea9ff1cc WatchSource:0}: Error finding container 4971b06c194e08b0025cf59f7368625757851754fc10d547ce144851ea9ff1cc: Status 404 returned error can't find the container with id 4971b06c194e08b0025cf59f7368625757851754fc10d547ce144851ea9ff1cc
Jul 01 17:16:19.582169 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:19.582151    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa148af326afdd0a2c33ab39aa85ac2.slice/crio-cbb6c1bf16e34a476a35ec06fe38464f024db606f653dcaddc2314e9836fca3f WatchSource:0}: Error finding container cbb6c1bf16e34a476a35ec06fe38464f024db606f653dcaddc2314e9836fca3f: Status 404 returned error can't find the container with id cbb6c1bf16e34a476a35ec06fe38464f024db606f653dcaddc2314e9836fca3f
Jul 01 17:16:19.587202 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.587178    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:16:19.589128 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.589111    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 17:16:19.589128 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.589120    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:19.599545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.599530    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 17:16:19.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.600929    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal"
Jul 01 17:16:19.601052 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.601027    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:11:18 +0000 UTC" deadline="2028-04-13 21:32:53.645597318 +0000 UTC"
Jul 01 17:16:19.601090 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.601055    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15652h16m34.044545643s"
Jul 01 17:16:19.602076 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.602064    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 17:16:19.609536 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.609518    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 17:16:19.627462 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.627413    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xsmz"
Jul 01 17:16:19.635483 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.635469    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xsmz"
Jul 01 17:16:19.656003 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.655957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal" event={"ID":"1c6f01bf881842f56beb7f6d6350515a","Type":"ContainerStarted","Data":"4971b06c194e08b0025cf59f7368625757851754fc10d547ce144851ea9ff1cc"}
Jul 01 17:16:19.657041 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:19.657025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal" event={"ID":"2aa148af326afdd0a2c33ab39aa85ac2","Type":"ContainerStarted","Data":"cbb6c1bf16e34a476a35ec06fe38464f024db606f653dcaddc2314e9836fca3f"}
Jul 01 17:16:20.568710 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.568681    2582 apiserver.go:52] "Watching apiserver"
Jul 01 17:16:20.581181 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.581152    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 17:16:20.582216 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.582190    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal","openshift-multus/multus-additional-cni-plugins-l6tnd","openshift-multus/network-metrics-daemon-fbptr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh","openshift-dns/node-resolver-rsq92","openshift-image-registry/node-ca-b44wl","openshift-multus/multus-g5r8q","openshift-network-diagnostics/network-check-target-wmjfv","openshift-network-operator/iptables-alerter-4sm6q","openshift-ovn-kubernetes/ovnkube-node-cdscv","kube-system/global-pull-secret-syncer-4hmvb","kube-system/konnectivity-agent-hrlxp","kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2bh4v"]
Jul 01 17:16:20.583620 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.583600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.584962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.584941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.585051 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.585013    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:20.586124 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.586282 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.586163    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:20.586331 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586319    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.586405 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586347    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 17:16:20.586554 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586528    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.586632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586619    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 17:16:20.586985 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.586969    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5nl79\""
Jul 01 17:16:20.587294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.587273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.588387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.588370    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.589517 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.589497    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.590406 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 17:16:20.590519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590426    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.590594 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590580    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gnsbf\""
Jul 01 17:16:20.590664 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.590771 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6qgmb\""
Jul 01 17:16:20.590992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.590974    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.591631 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.591613    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.591824 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.591805    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.592429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.592143    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.592429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.592158    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.592429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.592269    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 17:16:20.592429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.592382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.592663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.592534    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2gj6z\""
Jul 01 17:16:20.593389 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.593344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.593535 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.593394    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.593535 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.593428    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.593704 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.593686    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s5fkk\""
Jul 01 17:16:20.593923 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.593865    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 17:16:20.594815 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.594798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.595618 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.595603    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gfwkk\""
Jul 01 17:16:20.595713 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.595602    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.596029 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.596012    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.596109 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.596031    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 17:16:20.596205 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.596154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wzwpk\""
Jul 01 17:16:20.596376 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.596355    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 17:16:20.596487 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.596381    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:20.596553 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.596441    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:20.597302 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.597153    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 17:16:20.597302 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.597250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 17:16:20.597591 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.597572    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.597851 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.597819    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 17:16:20.598847 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.598831    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 17:16:20.599300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.599280    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 17:16:20.600604 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/c1fbf65a-b9e6-4082-838f-8e00a5395d63-kube-api-access-7tfkv\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.600681 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-sys-fs\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.600681 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.600766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.600766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph9xb\" (UniqueName: \"kubernetes.io/projected/c215cf4c-2590-4bb6-828a-935772c1c8fc-kube-api-access-ph9xb\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.600766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-cni-binary-copy\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.600766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-etc-kubernetes\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-dbus\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2e127d7-a966-42da-952f-dc130d74e0e3-iptables-alerter-script\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7nb\" (UniqueName: \"kubernetes.io/projected/a2e127d7-a966-42da-952f-dc130d74e0e3-kube-api-access-2g7nb\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600850    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zfmlc\""
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-netns\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-multus-certs\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.600942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-device-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ffx\" (UniqueName: \"kubernetes.io/projected/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kube-api-access-z2ffx\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.600985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1fbf65a-b9e6-4082-838f-8e00a5395d63-hosts-file\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-cnibin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c215cf4c-2590-4bb6-828a-935772c1c8fc-host\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-system-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-os-release\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-k8s-cni-cncf-io\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-bin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601192    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 17:16:20.601289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75qsb\" (UniqueName: \"kubernetes.io/projected/04af0054-c16b-4850-999a-a7dcdd8ad698-kube-api-access-75qsb\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-kubelet\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvsd\" (UniqueName: \"kubernetes.io/projected/68690aef-39ff-420b-9b85-9ed5bab421c0-kube-api-access-chvsd\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1fbf65a-b9e6-4082-838f-8e00a5395d63-tmp-dir\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-hostroot\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-registration-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-kubelet-config\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601526    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-socket-dir-parent\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601529    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xlkht\""
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-multus\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-socket-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601584    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c215cf4c-2590-4bb6-828a-935772c1c8fc-serviceca\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e127d7-a966-42da-952f-dc130d74e0e3-host-slash\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-conf-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.601711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-daemon-config\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.602190 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.601733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-etc-selinux\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.638607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.638568    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:11:19 +0000 UTC" deadline="2028-02-04 14:28:18.64699774 +0000 UTC"
Jul 01 17:16:20.638687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.638608    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13989h11m58.008393327s"
Jul 01 17:16:20.650142 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.650113    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:20.690849 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.690831    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 17:16:20.701986 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.701962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-bin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.701994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zprnw\" (UniqueName: \"kubernetes.io/projected/036bae6c-da67-4551-997c-f631db3be200-kube-api-access-zprnw\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.702094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-kubelet\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chvsd\" (UniqueName: \"kubernetes.io/projected/68690aef-39ff-420b-9b85-9ed5bab421c0-kube-api-access-chvsd\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.702094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702080    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-bin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-kubelet\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-etc-tuned\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-kubelet-config\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-socket-dir-parent\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-socket-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-netns\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.702276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-sys\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-host\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702318    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-kubelet-config\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c215cf4c-2590-4bb6-828a-935772c1c8fc-serviceca\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e127d7-a966-42da-952f-dc130d74e0e3-host-slash\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702381    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-socket-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-conf-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702425    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-conf-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702429    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e127d7-a966-42da-952f-dc130d74e0e3-host-slash\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702384    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-socket-dir-parent\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-etc-selinux\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-modprobe-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/c1fbf65a-b9e6-4082-838f-8e00a5395d63-kube-api-access-7tfkv\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-sys-fs\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-var-lib-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/036bae6c-da67-4551-997c-f631db3be200-ovn-node-metrics-cert\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-agent-certs\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.702607 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702650    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-etc-selinux\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-etc-kubernetes\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702723    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-sys-fs\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.702736    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-konnectivity-ca\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysconfig\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702781    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-etc-kubernetes\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702789    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c215cf4c-2590-4bb6-828a-935772c1c8fc-serviceca\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.702803    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:21.202767769 +0000 UTC m=+2.976354551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702794    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-bin\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7nb\" (UniqueName: \"kubernetes.io/projected/a2e127d7-a966-42da-952f-dc130d74e0e3-kube-api-access-2g7nb\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-device-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.703328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ffx\" (UniqueName: \"kubernetes.io/projected/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kube-api-access-z2ffx\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.702979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-systemd\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cnibin\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703056    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-device-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1fbf65a-b9e6-4082-838f-8e00a5395d63-hosts-file\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-systemd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1fbf65a-b9e6-4082-838f-8e00a5395d63-hosts-file\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-config\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-lib-modules\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6pwk\" (UniqueName: \"kubernetes.io/projected/66077784-1078-4d8e-9338-c011780ed767-kube-api-access-s6pwk\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-os-release\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-os-release\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-k8s-cni-cncf-io\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75qsb\" (UniqueName: \"kubernetes.io/projected/04af0054-c16b-4850-999a-a7dcdd8ad698-kube-api-access-75qsb\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703362    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-os-release\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703407    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-k8s-cni-cncf-io\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-system-cni-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1fbf65a-b9e6-4082-838f-8e00a5395d63-tmp-dir\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-hostroot\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-registration-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-node-log\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703561    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-hostroot\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-kubernetes\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-var-lib-kubelet\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703623    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/187c724e-4e25-49c3-b9e7-f5d4dcf93765-registration-dir\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-multus\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703655    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-ovn\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-log-socket\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-script-lib\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.704836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703732    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-var-lib-cni-multus\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703761    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1fbf65a-b9e6-4082-838f-8e00a5395d63-tmp-dir\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-conf\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87sm5\" (UniqueName: \"kubernetes.io/projected/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-kube-api-access-87sm5\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-daemon-config\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-systemd-units\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-netd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-slash\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.703993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph9xb\" (UniqueName: \"kubernetes.io/projected/c215cf4c-2590-4bb6-828a-935772c1c8fc-kube-api-access-ph9xb\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-cni-binary-copy\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-kubelet\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.704062    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:20.705284 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.704138    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:21.204121153 +0000 UTC m=+2.977707937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-tmp\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-dbus\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2e127d7-a966-42da-952f-dc130d74e0e3-iptables-alerter-script\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-netns\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-multus-certs\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704292    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-dbus\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-etc-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-run\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-netns\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704340    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-multus-daemon-config\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-cnibin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-env-overrides\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-host-run-multus-certs\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c215cf4c-2590-4bb6-828a-935772c1c8fc-host\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-system-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704465    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-cnibin\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.705756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c215cf4c-2590-4bb6-828a-935772c1c8fc-host\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.706302 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704547    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04af0054-c16b-4850-999a-a7dcdd8ad698-system-cni-dir\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.706302 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04af0054-c16b-4850-999a-a7dcdd8ad698-cni-binary-copy\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.706302 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.704756    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2e127d7-a966-42da-952f-dc130d74e0e3-iptables-alerter-script\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.709687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.709668    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 17:16:20.713803 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.713778    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/c1fbf65a-b9e6-4082-838f-8e00a5395d63-kube-api-access-7tfkv\") pod \"node-resolver-rsq92\" (UID: \"c1fbf65a-b9e6-4082-838f-8e00a5395d63\") " pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.713882 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.713846    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7nb\" (UniqueName: \"kubernetes.io/projected/a2e127d7-a966-42da-952f-dc130d74e0e3-kube-api-access-2g7nb\") pod \"iptables-alerter-4sm6q\" (UID: \"a2e127d7-a966-42da-952f-dc130d74e0e3\") " pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.713929 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.713890    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvsd\" (UniqueName: \"kubernetes.io/projected/68690aef-39ff-420b-9b85-9ed5bab421c0-kube-api-access-chvsd\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:20.713971 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.713958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ffx\" (UniqueName: \"kubernetes.io/projected/187c724e-4e25-49c3-b9e7-f5d4dcf93765-kube-api-access-z2ffx\") pod \"aws-ebs-csi-driver-node-kswbh\" (UID: \"187c724e-4e25-49c3-b9e7-f5d4dcf93765\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.714822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.714805    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph9xb\" (UniqueName: \"kubernetes.io/projected/c215cf4c-2590-4bb6-828a-935772c1c8fc-kube-api-access-ph9xb\") pod \"node-ca-b44wl\" (UID: \"c215cf4c-2590-4bb6-828a-935772c1c8fc\") " pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.715798 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.715777    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75qsb\" (UniqueName: \"kubernetes.io/projected/04af0054-c16b-4850-999a-a7dcdd8ad698-kube-api-access-75qsb\") pod \"multus-g5r8q\" (UID: \"04af0054-c16b-4850-999a-a7dcdd8ad698\") " pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.805023 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.804988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-node-log\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805023 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-kubernetes\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-var-lib-kubelet\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-ovn\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-log-socket\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805113    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-node-log\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-script-lib\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805141    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-kubernetes\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-var-lib-kubelet\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805193    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-log-socket\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-conf\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805242 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-ovn\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87sm5\" (UniqueName: \"kubernetes.io/projected/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-kube-api-access-87sm5\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-systemd-units\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-netd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-slash\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805317    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805358    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-netd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-systemd-units\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805362    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysctl-conf\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-slash\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-kubelet\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805526    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-kubelet\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-tmp\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-etc-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-run\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.805794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805668    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-etc-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805692    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-binary-copy\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-env-overrides\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805718    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805714    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-run\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zprnw\" (UniqueName: \"kubernetes.io/projected/036bae6c-da67-4551-997c-f631db3be200-kube-api-access-zprnw\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-etc-tuned\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-netns\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805802    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-sys\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-host\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805856    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-netns\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-modprobe-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-var-lib-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805904    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-sys\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/036bae6c-da67-4551-997c-f631db3be200-ovn-node-metrics-cert\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.806387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-agent-certs\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.805990    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-modprobe-d\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-host\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-konnectivity-ca\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806057    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-env-overrides\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysconfig\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806160    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-bin\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806163    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-sysconfig\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-var-lib-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806556    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-script-lib\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-cni-bin\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806593    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-systemd\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806740    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-etc-systemd\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806746    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-konnectivity-ca\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cnibin\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-systemd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806845    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-cnibin\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-config\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-lib-modules\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806891    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-systemd\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806901    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-host-run-ovn-kubernetes\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6pwk\" (UniqueName: \"kubernetes.io/projected/66077784-1078-4d8e-9338-c011780ed767-kube-api-access-s6pwk\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-os-release\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.806982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-system-cni-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.807000    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66077784-1078-4d8e-9338-c011780ed767-lib-modules\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.807047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-system-cni-dir\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.807105    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-os-release\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.807144    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/036bae6c-da67-4551-997c-f631db3be200-run-openvswitch\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.807899 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.807355    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/036bae6c-da67-4551-997c-f631db3be200-ovnkube-config\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.808562 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.808365    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-tmp\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.808670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.808652    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/036bae6c-da67-4551-997c-f631db3be200-ovn-node-metrics-cert\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.808767 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.808752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66077784-1078-4d8e-9338-c011780ed767-etc-tuned\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.809546 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.809508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2bbb4bf0-4114-46a0-a1d6-cdff0660477e-agent-certs\") pod \"konnectivity-agent-hrlxp\" (UID: \"2bbb4bf0-4114-46a0-a1d6-cdff0660477e\") " pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:20.815866 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.815849    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:20.815946 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.815871    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:20.815946 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.815901    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:20.816029 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:20.815955    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:21.315943485 +0000 UTC m=+3.089530267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:20.820318 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.820271    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zprnw\" (UniqueName: \"kubernetes.io/projected/036bae6c-da67-4551-997c-f631db3be200-kube-api-access-zprnw\") pod \"ovnkube-node-cdscv\" (UID: \"036bae6c-da67-4551-997c-f631db3be200\") " pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.820551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.820534    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6pwk\" (UniqueName: \"kubernetes.io/projected/66077784-1078-4d8e-9338-c011780ed767-kube-api-access-s6pwk\") pod \"tuned-2bh4v\" (UID: \"66077784-1078-4d8e-9338-c011780ed767\") " pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.820551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.820545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87sm5\" (UniqueName: \"kubernetes.io/projected/12c33db9-4a66-46c6-88f3-b5b0b6ebfd72-kube-api-access-87sm5\") pod \"multus-additional-cni-plugins-l6tnd\" (UID: \"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72\") " pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.894533 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.894507    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5r8q"
Jul 01 17:16:20.901469 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.901436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh"
Jul 01 17:16:20.912070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.912053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsq92"
Jul 01 17:16:20.917531 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.917515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b44wl"
Jul 01 17:16:20.923213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.923194    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sm6q"
Jul 01 17:16:20.930038 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.930019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2bh4v"
Jul 01 17:16:20.944382 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.944361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l6tnd"
Jul 01 17:16:20.950978 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.950960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:20.955793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:20.955769    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:21.209490 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.209446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:21.209619 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.209541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:21.209619 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.209553    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:21.209619 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.209611    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:22.209593583 +0000 UTC m=+3.983180396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:21.209619 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.209619    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:21.209794 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.209651    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:22.20964199 +0000 UTC m=+3.983228772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:21.410513 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.410483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:21.410675 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.410637    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:21.410675 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.410659    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:21.410675 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.410675    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:21.410819 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.410735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:22.410716894 +0000 UTC m=+4.184303690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:21.525133 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.525107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc215cf4c_2590_4bb6_828a_935772c1c8fc.slice/crio-b097022148b8d65584af11632a461e81b6869b29176941c8b6cc4ae217e978ae WatchSource:0}: Error finding container b097022148b8d65584af11632a461e81b6869b29176941c8b6cc4ae217e978ae: Status 404 returned error can't find the container with id b097022148b8d65584af11632a461e81b6869b29176941c8b6cc4ae217e978ae
Jul 01 17:16:21.526265 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.526236    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187c724e_4e25_49c3_b9e7_f5d4dcf93765.slice/crio-590686f8410abdd0547027cd491fb7ed2a7dfa61be788a46a3ffae0de3a8484e WatchSource:0}: Error finding container 590686f8410abdd0547027cd491fb7ed2a7dfa61be788a46a3ffae0de3a8484e: Status 404 returned error can't find the container with id 590686f8410abdd0547027cd491fb7ed2a7dfa61be788a46a3ffae0de3a8484e
Jul 01 17:16:21.526815 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.526794    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66077784_1078_4d8e_9338_c011780ed767.slice/crio-fa319abffb67a02e83ae323a2ca7dce2a7c7df05ec29d1e9cd45c5cc169566bf WatchSource:0}: Error finding container fa319abffb67a02e83ae323a2ca7dce2a7c7df05ec29d1e9cd45c5cc169566bf: Status 404 returned error can't find the container with id fa319abffb67a02e83ae323a2ca7dce2a7c7df05ec29d1e9cd45c5cc169566bf
Jul 01 17:16:21.528268 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.528183    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbb4bf0_4114_46a0_a1d6_cdff0660477e.slice/crio-45f544c880994f3a9b9d890ec6c0c900aee17c08237fb480c6e5a15048701013 WatchSource:0}: Error finding container 45f544c880994f3a9b9d890ec6c0c900aee17c08237fb480c6e5a15048701013: Status 404 returned error can't find the container with id 45f544c880994f3a9b9d890ec6c0c900aee17c08237fb480c6e5a15048701013
Jul 01 17:16:21.529401 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.529190    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04af0054_c16b_4850_999a_a7dcdd8ad698.slice/crio-40ab95eb7a86ab0c79733adbb1bd0f69c4a52fc8119bdb30819c2b1265823680 WatchSource:0}: Error finding container 40ab95eb7a86ab0c79733adbb1bd0f69c4a52fc8119bdb30819c2b1265823680: Status 404 returned error can't find the container with id 40ab95eb7a86ab0c79733adbb1bd0f69c4a52fc8119bdb30819c2b1265823680
Jul 01 17:16:21.530380 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.530105    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c33db9_4a66_46c6_88f3_b5b0b6ebfd72.slice/crio-7debaff701c9c4d711a8ebd21ded5f3bc8ac2ba54291930c9d79f3011e0401c9 WatchSource:0}: Error finding container 7debaff701c9c4d711a8ebd21ded5f3bc8ac2ba54291930c9d79f3011e0401c9: Status 404 returned error can't find the container with id 7debaff701c9c4d711a8ebd21ded5f3bc8ac2ba54291930c9d79f3011e0401c9
Jul 01 17:16:21.530758 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.530618    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036bae6c_da67_4551_997c_f631db3be200.slice/crio-953c480f4582bbc507c5706e3799b48421bd4d45c5b163dae9c11e7ce7cbb5ab WatchSource:0}: Error finding container 953c480f4582bbc507c5706e3799b48421bd4d45c5b163dae9c11e7ce7cbb5ab: Status 404 returned error can't find the container with id 953c480f4582bbc507c5706e3799b48421bd4d45c5b163dae9c11e7ce7cbb5ab
Jul 01 17:16:21.532421 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.532185    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e127d7_a966_42da_952f_dc130d74e0e3.slice/crio-b567380a11e858f4471e75044b09ab1371118de3575bf25d799052b04f763292 WatchSource:0}: Error finding container b567380a11e858f4471e75044b09ab1371118de3575bf25d799052b04f763292: Status 404 returned error can't find the container with id b567380a11e858f4471e75044b09ab1371118de3575bf25d799052b04f763292
Jul 01 17:16:21.533620 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:16:21.533587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1fbf65a_b9e6_4082_838f_8e00a5395d63.slice/crio-5246ba648e818bdf9cfeca64b994a4e1456be8c5489ff679ff4956fb155fa0be WatchSource:0}: Error finding container 5246ba648e818bdf9cfeca64b994a4e1456be8c5489ff679ff4956fb155fa0be: Status 404 returned error can't find the container with id 5246ba648e818bdf9cfeca64b994a4e1456be8c5489ff679ff4956fb155fa0be
Jul 01 17:16:21.633079 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.632956    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:21.639478 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.639410    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:11:19 +0000 UTC" deadline="2028-03-06 21:37:51.227557726 +0000 UTC"
Jul 01 17:16:21.639478 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.639473    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14740h21m29.588112451s"
Jul 01 17:16:21.653816 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.653798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:21.653915 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:21.653898    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:21.661486 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.661445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hrlxp" event={"ID":"2bbb4bf0-4114-46a0-a1d6-cdff0660477e","Type":"ContainerStarted","Data":"45f544c880994f3a9b9d890ec6c0c900aee17c08237fb480c6e5a15048701013"}
Jul 01 17:16:21.662805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.662779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh" event={"ID":"187c724e-4e25-49c3-b9e7-f5d4dcf93765","Type":"ContainerStarted","Data":"590686f8410abdd0547027cd491fb7ed2a7dfa61be788a46a3ffae0de3a8484e"}
Jul 01 17:16:21.663892 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.663870    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5r8q" event={"ID":"04af0054-c16b-4850-999a-a7dcdd8ad698","Type":"ContainerStarted","Data":"40ab95eb7a86ab0c79733adbb1bd0f69c4a52fc8119bdb30819c2b1265823680"}
Jul 01 17:16:21.664999 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.664977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b44wl" event={"ID":"c215cf4c-2590-4bb6-828a-935772c1c8fc","Type":"ContainerStarted","Data":"b097022148b8d65584af11632a461e81b6869b29176941c8b6cc4ae217e978ae"}
Jul 01 17:16:21.667070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.667051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal" event={"ID":"1c6f01bf881842f56beb7f6d6350515a","Type":"ContainerStarted","Data":"b25824ff31d26d1122eb1a5c57c46e31d71b1d862f9aaa5e62cd8d3b527fed7a"}
Jul 01 17:16:21.668160 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.668137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2bh4v" event={"ID":"66077784-1078-4d8e-9338-c011780ed767","Type":"ContainerStarted","Data":"fa319abffb67a02e83ae323a2ca7dce2a7c7df05ec29d1e9cd45c5cc169566bf"}
Jul 01 17:16:21.669351 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.669333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsq92" event={"ID":"c1fbf65a-b9e6-4082-838f-8e00a5395d63","Type":"ContainerStarted","Data":"5246ba648e818bdf9cfeca64b994a4e1456be8c5489ff679ff4956fb155fa0be"}
Jul 01 17:16:21.670529 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.670507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sm6q" event={"ID":"a2e127d7-a966-42da-952f-dc130d74e0e3","Type":"ContainerStarted","Data":"b567380a11e858f4471e75044b09ab1371118de3575bf25d799052b04f763292"}
Jul 01 17:16:21.671527 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.671507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"953c480f4582bbc507c5706e3799b48421bd4d45c5b163dae9c11e7ce7cbb5ab"}
Jul 01 17:16:21.672799 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.672778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerStarted","Data":"7debaff701c9c4d711a8ebd21ded5f3bc8ac2ba54291930c9d79f3011e0401c9"}
Jul 01 17:16:21.682745 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:21.682700    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-81.ec2.internal" podStartSLOduration=2.682683807 podStartE2EDuration="2.682683807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:21.682348916 +0000 UTC m=+3.455935715" watchObservedRunningTime="2026-07-01 17:16:21.682683807 +0000 UTC m=+3.456270613"
Jul 01 17:16:22.218822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.218742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:22.218822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.218808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:22.219120 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.219004    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:22.219120 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.219096    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:24.219078118 +0000 UTC m=+5.992664916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:22.219505 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.219484    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:22.219577 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.219562    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:24.219545764 +0000 UTC m=+5.993132562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:22.420606 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.420548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:22.420769 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.420759    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:22.420839 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.420777    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:22.420839 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.420789    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:22.420945 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.420843    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:24.420826689 +0000 UTC m=+6.194413475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:22.519750 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.519684    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 17:16:22.656389 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.656360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:22.656832 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.656490    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:22.656889 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.656861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:22.657054 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:22.656945    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:22.685425 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.685396    2582 generic.go:356] "Generic (PLEG): container finished" podID="2aa148af326afdd0a2c33ab39aa85ac2" containerID="8658f691eefc5a63610b103fc008e4ffc12de762fa72312f475f602bbf2a7314" exitCode=0
Jul 01 17:16:22.686143 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:22.685896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal" event={"ID":"2aa148af326afdd0a2c33ab39aa85ac2","Type":"ContainerDied","Data":"8658f691eefc5a63610b103fc008e4ffc12de762fa72312f475f602bbf2a7314"}
Jul 01 17:16:23.654016 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:23.653981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:23.654190 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:23.654114    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:23.703790 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:23.703757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal" event={"ID":"2aa148af326afdd0a2c33ab39aa85ac2","Type":"ContainerStarted","Data":"e328fd95bbc2fc86f6ed55f7633f4f8d00a0efcd850d49e9240496bad3e424b9"}
Jul 01 17:16:24.234364 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:24.234325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:24.234573 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:24.234412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:24.234652 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.234598    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:24.234702 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.234666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.23464473 +0000 UTC m=+10.008231525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:24.235577 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.235130    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:24.235577 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.235186    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.235169683 +0000 UTC m=+10.008756466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:24.436251 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:24.436198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:24.436445 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.436386    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:24.436445 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.436407    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:24.436445 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.436464    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:24.436648 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.436536    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.436517301 +0000 UTC m=+10.210104105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:24.655083 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:24.654546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:24.655083 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.654665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:24.655083 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:24.654894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:24.655083 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:24.654994    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:25.653582 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:25.653540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:25.653935 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:25.653658    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:26.656056 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:26.656023    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:26.656421 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:26.656123    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:26.656540 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:26.656526    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:26.656627 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:26.656612    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:27.654300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:27.654269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:27.654506 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:27.654406    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:28.272775 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:28.272740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:28.273219 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:28.272803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:28.273219 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.272930    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:28.273219 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.272987    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:36.272969516 +0000 UTC m=+18.046556298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:28.273383 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.273362    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:28.273433 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.273415    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:36.27339758 +0000 UTC m=+18.046984375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:28.474465 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:28.474410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:28.474637 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.474609    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:28.474637 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.474633    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:28.474743 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.474645    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:28.474743 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.474711    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:36.474683028 +0000 UTC m=+18.248269828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:28.656740 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:28.656652    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:28.656893 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.656783    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:28.656893 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:28.656840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:28.657015 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:28.656902    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:29.653682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:29.653647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:29.654068 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:29.653787    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:30.654404 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:30.654356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:30.658534 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:30.654505    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:30.658534 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:30.654576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:30.658534 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:30.654698    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:31.653473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:31.653430    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:31.653642 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:31.653559    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:32.653723 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:32.653690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:32.653723 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:32.653706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:32.654190 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:32.653806    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:32.654190 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:32.653954    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:33.653739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:33.653705    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:33.654168 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:33.653841    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:34.654322 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:34.654267    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:34.654322 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:34.654321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:34.655046 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:34.654411    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:34.655046 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:34.654577    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:35.653756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:35.653721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:35.653945 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:35.653828    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:36.338203 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:36.338159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:36.338671 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:36.338234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:36.338671 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.338335    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:36.338671 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.338417    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:52.338395571 +0000 UTC m=+34.111982371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:36.338671 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.338343    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:36.338671 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.338498    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:16:52.338484538 +0000 UTC m=+34.112071331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:36.540342 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:36.540305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:36.540525 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.540490    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:36.540525 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.540521    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:36.540624 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.540535    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:36.540624 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.540596    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:16:52.54057798 +0000 UTC m=+34.314164770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:36.654518 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:36.654416    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:36.654667 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.654549    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:36.654895 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:36.654416    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:36.654895 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:36.654861    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:37.653469 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:37.653426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:37.653913 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:37.653560    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:38.654411 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:38.654380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:38.654813 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:38.654509    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:38.654813 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:38.654577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:38.654813 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:38.654669    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:39.653710 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:39.653672    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:39.653865 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:39.653786    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:40.654768 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.654399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:40.655761 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.654426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:40.655761 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:40.654874    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:40.655761 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:40.654907    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:40.738723 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.738639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2bh4v" event={"ID":"66077784-1078-4d8e-9338-c011780ed767","Type":"ContainerStarted","Data":"780aac1fbf150693acb91eda2a1c69cc4ea2dcb8967954b0b6f61e7f37183b02"}
Jul 01 17:16:40.740646 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.740598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsq92" event={"ID":"c1fbf65a-b9e6-4082-838f-8e00a5395d63","Type":"ContainerStarted","Data":"96dfa37997d7f7699a6482f0141c39cfca881a34fbdbdacd5d39919e2824ddf4"}
Jul 01 17:16:40.744092 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744070    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:16:40.744494 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744471    2582 generic.go:356] "Generic (PLEG): container finished" podID="036bae6c-da67-4551-997c-f631db3be200" containerID="15be72e2c6882cafa542fbf69656dea4cea3842a52f268771ac2ca9a83c1ca5f" exitCode=1
Jul 01 17:16:40.744601 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"64282ceab4b2b42d3c656751798404348e9bb81c2bbfa82994bdf8d3a72d6265"}
Jul 01 17:16:40.744662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"f5d592a18ae46d90ac46f5b18395d56e197a44a27f5b281d4d539e0784a4fc73"}
Jul 01 17:16:40.744704 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"f6dead1e8f8c32527692dd3f36e50df9dcea6cd0d0c170b276c05ab383f2f40f"}
Jul 01 17:16:40.744739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"76724abe35f43215f6c55d9a9630fa1f254c7ae249437714e94b33f020374655"}
Jul 01 17:16:40.744782 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerDied","Data":"15be72e2c6882cafa542fbf69656dea4cea3842a52f268771ac2ca9a83c1ca5f"}
Jul 01 17:16:40.744816 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.744803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"8401b7b7d0a4a7552966bde1d061bb7a8c8fb094006b3e8ffac67b2626843f88"}
Jul 01 17:16:40.746174 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.746151    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="aed23f458417d71acf81929cf837fbe72fdd408c07ff37295860770df9a76620" exitCode=0
Jul 01 17:16:40.746283 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.746229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"aed23f458417d71acf81929cf837fbe72fdd408c07ff37295860770df9a76620"}
Jul 01 17:16:40.747791 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.747771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hrlxp" event={"ID":"2bbb4bf0-4114-46a0-a1d6-cdff0660477e","Type":"ContainerStarted","Data":"634cfbead8573b1717c721679a829878aa2a4795f2d9e3674d0d917cd1cd2ce5"}
Jul 01 17:16:40.750497 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.750417    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh" event={"ID":"187c724e-4e25-49c3-b9e7-f5d4dcf93765","Type":"ContainerStarted","Data":"8c32b33f67240a3295901c514903d16f06c898c812550da3cd1e9913c3f1415c"}
Jul 01 17:16:40.752662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.752641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5r8q" event={"ID":"04af0054-c16b-4850-999a-a7dcdd8ad698","Type":"ContainerStarted","Data":"dd0496f1feba1b87143f4c50efed7f66b81cf3c6dc531790d1256031157186fc"}
Jul 01 17:16:40.753984 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.753964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b44wl" event={"ID":"c215cf4c-2590-4bb6-828a-935772c1c8fc","Type":"ContainerStarted","Data":"0bb95218d18d22dbef00832394c9b80e38e3100e2eea80daba0f60ddb8aa70c4"}
Jul 01 17:16:40.756190 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.756155    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2bh4v" podStartSLOduration=4.360859119 podStartE2EDuration="22.756129274s" totalImagesPullingTime="18.395270155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:40.756104134 +0000 UTC m=+22.529690939" watchObservedRunningTime="2026-07-01 17:16:40.756129274 +0000 UTC m=+22.529716060"
Jul 01 17:16:40.756345 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.756323    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-81.ec2.internal" podStartSLOduration=21.756314682 podStartE2EDuration="21.756314682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:23.721569168 +0000 UTC m=+5.495155972" watchObservedRunningTime="2026-07-01 17:16:40.756314682 +0000 UTC m=+22.529901486"
Jul 01 17:16:40.776798 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.776753    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rsq92" podStartSLOduration=4.40655943 podStartE2EDuration="22.776740461s" totalImagesPullingTime="18.370181031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:40.776554637 +0000 UTC m=+22.550141444" watchObservedRunningTime="2026-07-01 17:16:40.776740461 +0000 UTC m=+22.550327264"
Jul 01 17:16:40.812983 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.812936    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hrlxp" podStartSLOduration=12.458340373 podStartE2EDuration="22.812919516s" totalImagesPullingTime="10.354579143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:40.812890935 +0000 UTC m=+22.586477740" watchObservedRunningTime="2026-07-01 17:16:40.812919516 +0000 UTC m=+22.586506312"
Jul 01 17:16:40.846924 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:40.846879    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g5r8q" podStartSLOduration=4.4143402 podStartE2EDuration="22.846862489s" totalImagesPullingTime="18.432522289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:40.830014772 +0000 UTC m=+22.603601588" watchObservedRunningTime="2026-07-01 17:16:40.846862489 +0000 UTC m=+22.620449291"
Jul 01 17:16:41.439560 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.439531    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 17:16:41.653858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.653792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:41.654085 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:41.653906    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:41.655926 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.655851    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:16:41.439553576Z","UUID":"87f204d4-a92c-442e-871f-da786a3ff345","Handler":null,"Name":"","Endpoint":""}
Jul 01 17:16:41.657576 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.657556    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 17:16:41.657705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.657593    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 17:16:41.758465 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.758424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sm6q" event={"ID":"a2e127d7-a966-42da-952f-dc130d74e0e3","Type":"ContainerStarted","Data":"af964b7b71a5aee0005f7adafc1b2a543359b26a8934663e9e37462155dea9aa"}
Jul 01 17:16:41.760635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.760599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh" event={"ID":"187c724e-4e25-49c3-b9e7-f5d4dcf93765","Type":"ContainerStarted","Data":"d7ebecf57c3396129e3706e98e38c2797b48e4d99664e8a842c91a29d7bceb6f"}
Jul 01 17:16:41.772680 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.772634    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b44wl" podStartSLOduration=5.39179839 podStartE2EDuration="23.772619274s" totalImagesPullingTime="18.380820884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:40.846995123 +0000 UTC m=+22.620581909" watchObservedRunningTime="2026-07-01 17:16:41.772619274 +0000 UTC m=+23.546206102"
Jul 01 17:16:41.772841 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:41.772799    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4sm6q" podStartSLOduration=5.40138175 podStartE2EDuration="23.77279493s" totalImagesPullingTime="18.37141318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:41.772536398 +0000 UTC m=+23.546123200" watchObservedRunningTime="2026-07-01 17:16:41.77279493 +0000 UTC m=+23.546381733"
Jul 01 17:16:42.657241 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:42.657208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:42.657705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:42.657209    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:42.657705 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:42.657311    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:42.657705 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:42.657391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:43.157761 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.157723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:43.158425 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.158402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:43.653961 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.653890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:43.654124 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:43.654005    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:43.768669 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.768633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh" event={"ID":"187c724e-4e25-49c3-b9e7-f5d4dcf93765","Type":"ContainerStarted","Data":"24118c7950af4322c89353310c264dbe655a8e109e6b7e99595fc40baa052285"}
Jul 01 17:16:43.772480 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.771978    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:16:43.772889 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.772864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"648c2d99222d5ccb878754e83adcd3f9b46e132c79ecd9a585991218093a85ba"}
Jul 01 17:16:43.773037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.772941    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:43.773383 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.773365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hrlxp"
Jul 01 17:16:43.787277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:43.787231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kswbh" podStartSLOduration=4.991818922 podStartE2EDuration="25.787215855s" totalImagesPullingTime="20.795396933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:43.786552397 +0000 UTC m=+25.560139204" watchObservedRunningTime="2026-07-01 17:16:43.787215855 +0000 UTC m=+25.560802658"
Jul 01 17:16:44.654733 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:44.654529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:44.654925 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:44.654542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:44.654925 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:44.654838    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:44.655015 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:44.654921    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:45.653934 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.653701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:45.654617 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:45.653961    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:45.780194 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.780168    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:16:45.780552 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.780521    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"e037ddc9682aa57b12f9e38582de75b6e97aa8fa2eab4355fbe82c9626d59e00"}
Jul 01 17:16:45.780816 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.780794    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:45.781068 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.780871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:45.781068 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.780992    2582 scope.go:117] "RemoveContainer" containerID="15be72e2c6882cafa542fbf69656dea4cea3842a52f268771ac2ca9a83c1ca5f"
Jul 01 17:16:45.782499 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.782475    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="bfbc1c8fc69eb9f3639744757e8818ffe3ad8d27bd9e16982db7615908489eec" exitCode=0
Jul 01 17:16:45.782579 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.782555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"bfbc1c8fc69eb9f3639744757e8818ffe3ad8d27bd9e16982db7615908489eec"}
Jul 01 17:16:45.796877 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:45.796857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:46.653999 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.653920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:46.653999 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.653937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:46.654719 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:46.654028    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:46.654719 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:46.654145    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:46.788981 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.788957    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:16:46.789330 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.789303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" event={"ID":"036bae6c-da67-4551-997c-f631db3be200","Type":"ContainerStarted","Data":"4907867d9a1b8cfb89a44150b5229dafbb90d344495c4c62adec1d37f1368ceb"}
Jul 01 17:16:46.789568 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.789540    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:46.804825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.804803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:16:46.821804 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:46.821755    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv" podStartSLOduration=10.37950293 podStartE2EDuration="28.821741154s" totalImagesPullingTime="18.442238224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:46.818011906 +0000 UTC m=+28.591598722" watchObservedRunningTime="2026-07-01 17:16:46.821741154 +0000 UTC m=+28.595327960"
Jul 01 17:16:47.105268 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.105234    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbptr"]
Jul 01 17:16:47.105487 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.105421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:47.105582 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:47.105557    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:47.108785 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.108760    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hmvb"]
Jul 01 17:16:47.109012 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.108868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:47.109012 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:47.108960    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:47.109526 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.109504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmjfv"]
Jul 01 17:16:47.109647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.109602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:47.109709 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:47.109692    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:47.339977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.339953    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsq92_c1fbf65a-b9e6-4082-838f-8e00a5395d63/dns-node-resolver/0.log"
Jul 01 17:16:47.793993 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.793957    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="800f406fefd3005b51e8f78d0744aee07fe4eb6e4279dfa3c2702eabd32f20e8" exitCode=0
Jul 01 17:16:47.794575 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:47.794023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"800f406fefd3005b51e8f78d0744aee07fe4eb6e4279dfa3c2702eabd32f20e8"}
Jul 01 17:16:48.118510 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:48.118413    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b44wl_c215cf4c-2590-4bb6-828a-935772c1c8fc/node-ca/0.log"
Jul 01 17:16:48.657058 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:48.657026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:48.657238 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:48.657111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:48.657238 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:48.657118    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:48.657238 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:48.657131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:48.657238 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:48.657209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:48.657424 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:48.657285    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:49.800538 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:49.800263    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="8c58ee76c386beef4f8acf74e0d3d5cc1015871b90372c4ce259fb11dfa210bc" exitCode=0
Jul 01 17:16:49.800538 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:49.800335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"8c58ee76c386beef4f8acf74e0d3d5cc1015871b90372c4ce259fb11dfa210bc"}
Jul 01 17:16:50.653920 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:50.653880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:50.654118 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:50.653880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:50.654118 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:50.654026    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:50.654118 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:50.653880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:50.654118 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:50.654093    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:50.654283 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:50.654140    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:52.354116 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.354076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:52.354678 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.354145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:52.354678 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.354276    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:52.354678 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.354325    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret podName:b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd nodeName:}" failed. No retries permitted until 2026-07-01 17:17:24.354310013 +0000 UTC m=+66.127896798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret") pod "global-pull-secret-syncer-4hmvb" (UID: "b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd") : object "kube-system"/"original-pull-secret" not registered
Jul 01 17:16:52.354678 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.354384    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:52.354678 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.354412    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs podName:68690aef-39ff-420b-9b85-9ed5bab421c0 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:24.354404585 +0000 UTC m=+66.127991367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs") pod "network-metrics-daemon-fbptr" (UID: "68690aef-39ff-420b-9b85-9ed5bab421c0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 17:16:52.555991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.555957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:52.556174 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.556112    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 17:16:52.556174 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.556132    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 17:16:52.556174 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.556143    2582 projected.go:196] Error preparing data for projected volume kube-api-access-s28pk for pod openshift-network-diagnostics/network-check-target-wmjfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:52.556352 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.556205    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk podName:768e2e4c-2b81-4578-8676-9292a482fd2b nodeName:}" failed. No retries permitted until 2026-07-01 17:17:24.556186987 +0000 UTC m=+66.329773770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s28pk" (UniqueName: "kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk") pod "network-check-target-wmjfv" (UID: "768e2e4c-2b81-4578-8676-9292a482fd2b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 17:16:52.653743 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.653663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:52.653910 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.653674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:52.653910 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:52.653795    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:52.653910 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.653785    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:52.653910 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.653882    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:52.654107 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:52.653962    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:54.654363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:54.654332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:54.654867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:54.654332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:54.654867 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:54.654442    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:54.654867 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:54.654557    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:54.654867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:54.654332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:54.654867 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:54.654675    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:55.817071 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:55.817040    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="fc80dba511a9e035d0014683b8afbf2635a8a010a3c0829093b7b1089429d3e8" exitCode=0
Jul 01 17:16:55.817696 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:55.817100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"fc80dba511a9e035d0014683b8afbf2635a8a010a3c0829093b7b1089429d3e8"}
Jul 01 17:16:56.653589 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:56.653545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:56.653795 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:56.653545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:56.653795 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:56.653656    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:56.653795 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:56.653669    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:56.653795 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:56.653734    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:56.653998 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:56.653793    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:16:56.821965 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:56.821930    2582 generic.go:356] "Generic (PLEG): container finished" podID="12c33db9-4a66-46c6-88f3-b5b0b6ebfd72" containerID="5775cbfb3c6a759914eb3f6c96df05f036e182c1990decefa42644f1bef293bc" exitCode=0
Jul 01 17:16:56.822474 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:56.822006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerDied","Data":"5775cbfb3c6a759914eb3f6c96df05f036e182c1990decefa42644f1bef293bc"}
Jul 01 17:16:57.827706 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:57.827425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" event={"ID":"12c33db9-4a66-46c6-88f3-b5b0b6ebfd72","Type":"ContainerStarted","Data":"279b72d279eef73a2e5e5eae01d0017843e46c938a657aefce4a2b2294691d52"}
Jul 01 17:16:57.855876 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:57.855796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l6tnd" podStartSLOduration=9.613457591 podStartE2EDuration="39.855780879s" totalImagesPullingTime="30.242323288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:57.855185135 +0000 UTC m=+39.628772015" watchObservedRunningTime="2026-07-01 17:16:57.855780879 +0000 UTC m=+39.629367682"
Jul 01 17:16:58.657313 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:58.657271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:16:58.657498 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:58.657272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:16:58.657498 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:58.657387    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:16:58.657498 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:16:58.657272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:16:58.657498 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:58.657479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:16:58.657716 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:16:58.657587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:00.654026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:00.653992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:00.654026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:00.654018    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:00.654504 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:00.653995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:00.654504 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:00.654109    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:00.654504 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:00.654185    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:00.654504 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:00.654249    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:02.654560 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:02.654527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:02.655037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:02.654528    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:02.655037 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:02.654633    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:02.655037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:02.654644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:02.655037 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:02.654718    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:02.655037 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:02.654785    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:04.653522 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:04.653486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:04.653522 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:04.653504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:04.653522 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:04.653514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:04.654086 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:04.653589    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:04.654086 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:04.653679    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:04.654086 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:04.653764    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:06.653878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:06.653846    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:06.654280 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:06.653855    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:06.654280 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:06.653939    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:06.654280 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:06.654030    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:06.654280 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:06.653856    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:06.654280 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:06.654110    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:08.654750 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:08.654718    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:08.655140 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:08.654844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:08.655140 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:08.654849    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:08.655140 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:08.654922    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:08.655140 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:08.654946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:08.655140 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:08.655002    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:10.654410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:10.654376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:10.654831 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:10.654380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:10.654831 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:10.654513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hmvb" podUID="b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd"
Jul 01 17:17:10.654831 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:10.654561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:10.654831 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:10.654654    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbptr" podUID="68690aef-39ff-420b-9b85-9ed5bab421c0"
Jul 01 17:17:10.654831 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:10.654735    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmjfv" podUID="768e2e4c-2b81-4578-8676-9292a482fd2b"
Jul 01 17:17:12.006432 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.006403    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-81.ec2.internal" event="NodeReady"
Jul 01 17:17:12.006816 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.006540    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 17:17:12.054976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.054943    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hthck"]
Jul 01 17:17:12.074763 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.074735    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t7k2s"]
Jul 01 17:17:12.074938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.074878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.077439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.077415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rrh5\""
Jul 01 17:17:12.077439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.077429    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 17:17:12.077661 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.077491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 17:17:12.077661 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.077600    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 17:17:12.099029 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.099010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hthck"]
Jul 01 17:17:12.099148 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.099037    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7k2s"]
Jul 01 17:17:12.099148 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.099121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.101641 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.101624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kz4nh\""
Jul 01 17:17:12.101745 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.101727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 17:17:12.101976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.101961    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 17:17:12.102044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.101963    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 17:17:12.102044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.101998    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 17:17:12.155331 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.155300    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-629b7"]
Jul 01 17:17:12.177639 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.177614    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-629b7"]
Jul 01 17:17:12.177782 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.177710    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.180903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.180881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 17:17:12.180903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.180904    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 17:17:12.181093 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.180911    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8946\""
Jul 01 17:17:12.189802 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.189779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqsmz\" (UniqueName: \"kubernetes.io/projected/d841581c-27b7-4b3b-b771-e887a23de0aa-kube-api-access-dqsmz\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.189906 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.189849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d841581c-27b7-4b3b-b771-e887a23de0aa-cert\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.290590 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5895bd2d-db64-472e-b28b-bf60cea89667-tmp-dir\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmxv\" (UniqueName: \"kubernetes.io/projected/a8718870-34e5-469c-91dd-4b22e61820ef-kube-api-access-2pmxv\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5895bd2d-db64-472e-b28b-bf60cea89667-metrics-tls\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8718870-34e5-469c-91dd-4b22e61820ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqsmz\" (UniqueName: \"kubernetes.io/projected/d841581c-27b7-4b3b-b771-e887a23de0aa-kube-api-access-dqsmz\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gpc\" (UniqueName: \"kubernetes.io/projected/5895bd2d-db64-472e-b28b-bf60cea89667-kube-api-access-t9gpc\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.290781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5895bd2d-db64-472e-b28b-bf60cea89667-config-volume\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.291026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d841581c-27b7-4b3b-b771-e887a23de0aa-cert\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.291026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8718870-34e5-469c-91dd-4b22e61820ef-data-volume\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.291026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8718870-34e5-469c-91dd-4b22e61820ef-crio-socket\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.291026 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.290963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8718870-34e5-469c-91dd-4b22e61820ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.295238 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.295205    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d841581c-27b7-4b3b-b771-e887a23de0aa-cert\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.300115 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.300091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqsmz\" (UniqueName: \"kubernetes.io/projected/d841581c-27b7-4b3b-b771-e887a23de0aa-kube-api-access-dqsmz\") pod \"ingress-canary-hthck\" (UID: \"d841581c-27b7-4b3b-b771-e887a23de0aa\") " pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.383882 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.383843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hthck"
Jul 01 17:17:12.392120 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5895bd2d-db64-472e-b28b-bf60cea89667-config-volume\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.392240 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8718870-34e5-469c-91dd-4b22e61820ef-data-volume\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392240 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8718870-34e5-469c-91dd-4b22e61820ef-crio-socket\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392240 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8718870-34e5-469c-91dd-4b22e61820ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392240 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5895bd2d-db64-472e-b28b-bf60cea89667-tmp-dir\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.392240 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmxv\" (UniqueName: \"kubernetes.io/projected/a8718870-34e5-469c-91dd-4b22e61820ef-kube-api-access-2pmxv\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392487 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5895bd2d-db64-472e-b28b-bf60cea89667-metrics-tls\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.392487 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8718870-34e5-469c-91dd-4b22e61820ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392487 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gpc\" (UniqueName: \"kubernetes.io/projected/5895bd2d-db64-472e-b28b-bf60cea89667-kube-api-access-t9gpc\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.392789 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392767    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8718870-34e5-469c-91dd-4b22e61820ef-data-volume\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a8718870-34e5-469c-91dd-4b22e61820ef-crio-socket\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.392963 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.392896    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5895bd2d-db64-472e-b28b-bf60cea89667-tmp-dir\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.393136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.393108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a8718870-34e5-469c-91dd-4b22e61820ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.393311 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.393286    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5895bd2d-db64-472e-b28b-bf60cea89667-config-volume\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.396398 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.396082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a8718870-34e5-469c-91dd-4b22e61820ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.396398 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.396145    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5895bd2d-db64-472e-b28b-bf60cea89667-metrics-tls\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.400937 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.400912    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmxv\" (UniqueName: \"kubernetes.io/projected/a8718870-34e5-469c-91dd-4b22e61820ef-kube-api-access-2pmxv\") pod \"insights-runtime-extractor-t7k2s\" (UID: \"a8718870-34e5-469c-91dd-4b22e61820ef\") " pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.401030 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.400978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gpc\" (UniqueName: \"kubernetes.io/projected/5895bd2d-db64-472e-b28b-bf60cea89667-kube-api-access-t9gpc\") pod \"dns-default-629b7\" (UID: \"5895bd2d-db64-472e-b28b-bf60cea89667\") " pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.406628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.406610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7k2s"
Jul 01 17:17:12.486718 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.486679    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:12.585348 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.585319    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7k2s"]
Jul 01 17:17:12.591207 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:12.591179    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8718870_34e5_469c_91dd_4b22e61820ef.slice/crio-8fb4abc944319c8828261c643b54d0c9105965effca8a0aa5ff077c7bed3201e WatchSource:0}: Error finding container 8fb4abc944319c8828261c643b54d0c9105965effca8a0aa5ff077c7bed3201e: Status 404 returned error can't find the container with id 8fb4abc944319c8828261c643b54d0c9105965effca8a0aa5ff077c7bed3201e
Jul 01 17:17:12.599089 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.599058    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hthck"]
Jul 01 17:17:12.603040 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:12.603013    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd841581c_27b7_4b3b_b771_e887a23de0aa.slice/crio-5f91a777a2c851a450fc89f4dddbdeab9bc4dbb3b61256563dca284ba4529856 WatchSource:0}: Error finding container 5f91a777a2c851a450fc89f4dddbdeab9bc4dbb3b61256563dca284ba4529856: Status 404 returned error can't find the container with id 5f91a777a2c851a450fc89f4dddbdeab9bc4dbb3b61256563dca284ba4529856
Jul 01 17:17:12.644662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.644568    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-629b7"]
Jul 01 17:17:12.647550 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:12.647525    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5895bd2d_db64_472e_b28b_bf60cea89667.slice/crio-ff73199ddde2e9798c77db5bf5afd825e7c8800a30876c92b4912855eb1f7693 WatchSource:0}: Error finding container ff73199ddde2e9798c77db5bf5afd825e7c8800a30876c92b4912855eb1f7693: Status 404 returned error can't find the container with id ff73199ddde2e9798c77db5bf5afd825e7c8800a30876c92b4912855eb1f7693
Jul 01 17:17:12.654043 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.654026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:12.654155 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.654027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:12.654213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.654164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:12.658286 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.658263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 17:17:12.658381 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.658330    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hpmk\""
Jul 01 17:17:12.658633 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.658617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 17:17:12.658721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.658688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 17:17:12.658721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.658691    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 17:17:12.659413 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.659399    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x7ht4\""
Jul 01 17:17:12.860793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.860694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-629b7" event={"ID":"5895bd2d-db64-472e-b28b-bf60cea89667","Type":"ContainerStarted","Data":"ff73199ddde2e9798c77db5bf5afd825e7c8800a30876c92b4912855eb1f7693"}
Jul 01 17:17:12.861766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.861741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7k2s" event={"ID":"a8718870-34e5-469c-91dd-4b22e61820ef","Type":"ContainerStarted","Data":"8fb4abc944319c8828261c643b54d0c9105965effca8a0aa5ff077c7bed3201e"}
Jul 01 17:17:12.862707 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:12.862687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hthck" event={"ID":"d841581c-27b7-4b3b-b771-e887a23de0aa","Type":"ContainerStarted","Data":"5f91a777a2c851a450fc89f4dddbdeab9bc4dbb3b61256563dca284ba4529856"}
Jul 01 17:17:14.501136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.501100    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"]
Jul 01 17:17:14.513544 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.513512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:14.515400 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.515374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"]
Jul 01 17:17:14.516520 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.516491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gwbx7\""
Jul 01 17:17:14.516657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.516639    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 01 17:17:14.617903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.617865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-xwllh\" (UID: \"f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:14.718968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.718932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-xwllh\" (UID: \"f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:14.721979 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.721929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-xwllh\" (UID: \"f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:14.825687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:14.825655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:17.778113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:17.778079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"]
Jul 01 17:17:18.006187 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:18.006160    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71b7e81_aa0c_4c9d_b4c8_ac89aa9a30a0.slice/crio-73f52f72605ac42f54f45dd6381887571c77363a1613efc4acf0d834c3177170 WatchSource:0}: Error finding container 73f52f72605ac42f54f45dd6381887571c77363a1613efc4acf0d834c3177170: Status 404 returned error can't find the container with id 73f52f72605ac42f54f45dd6381887571c77363a1613efc4acf0d834c3177170
Jul 01 17:17:18.739971 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.739940    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-nvbdg"]
Jul 01 17:17:18.742090 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.742071    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:18.745059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.745034    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 17:17:18.745753 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.745734    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 17:17:18.746121 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.746105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4zwt9\""
Jul 01 17:17:18.750068 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.750048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjrg\" (UniqueName: \"kubernetes.io/projected/95e1f23f-3ae7-4588-a9b0-0af731271312-kube-api-access-bbjrg\") pod \"downloads-5499b6fb8f-nvbdg\" (UID: \"95e1f23f-3ae7-4588-a9b0-0af731271312\") " pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:18.754250 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.754226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-nvbdg"]
Jul 01 17:17:18.806967 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.806934    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cdscv"
Jul 01 17:17:18.851438 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.851405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjrg\" (UniqueName: \"kubernetes.io/projected/95e1f23f-3ae7-4588-a9b0-0af731271312-kube-api-access-bbjrg\") pod \"downloads-5499b6fb8f-nvbdg\" (UID: \"95e1f23f-3ae7-4588-a9b0-0af731271312\") " pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:18.860423 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.860391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjrg\" (UniqueName: \"kubernetes.io/projected/95e1f23f-3ae7-4588-a9b0-0af731271312-kube-api-access-bbjrg\") pod \"downloads-5499b6fb8f-nvbdg\" (UID: \"95e1f23f-3ae7-4588-a9b0-0af731271312\") " pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:18.882066 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.882034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-629b7" event={"ID":"5895bd2d-db64-472e-b28b-bf60cea89667","Type":"ContainerStarted","Data":"e77e0f492ea7e37024cf83f46786fea067e7da6d8c489d1ee55f0f6912e975b2"}
Jul 01 17:17:18.882277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.882084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-629b7" event={"ID":"5895bd2d-db64-472e-b28b-bf60cea89667","Type":"ContainerStarted","Data":"aaa519f16820e4ad084321cc3af2fd455f6ac449009acb7a4011f0609ed2105e"}
Jul 01 17:17:18.882277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.882168    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:18.883514 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.883489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7k2s" event={"ID":"a8718870-34e5-469c-91dd-4b22e61820ef","Type":"ContainerStarted","Data":"21fe8fd1980a955626bcd3fe34ee7fb3b79b1cdeb7ff999cd6d97cf44a811ce9"}
Jul 01 17:17:18.884748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.884725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hthck" event={"ID":"d841581c-27b7-4b3b-b771-e887a23de0aa","Type":"ContainerStarted","Data":"59140b39c624f9b8f0ca3525067358ab724680dcbbaa5c73d5cacb81ab3194eb"}
Jul 01 17:17:18.885726 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.885704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh" event={"ID":"f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0","Type":"ContainerStarted","Data":"73f52f72605ac42f54f45dd6381887571c77363a1613efc4acf0d834c3177170"}
Jul 01 17:17:18.901510 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.901444    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-629b7" podStartSLOduration=1.5466281670000002 podStartE2EDuration="6.901426517s" totalImagesPullingTime="5.35479835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:18.900427444 +0000 UTC m=+60.674014249" watchObservedRunningTime="2026-07-01 17:17:18.901426517 +0000 UTC m=+60.675013321"
Jul 01 17:17:18.921418 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:18.921358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hthck" podStartSLOduration=1.5221083709999998 podStartE2EDuration="6.921335757s" totalImagesPullingTime="5.399227386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:18.920592951 +0000 UTC m=+60.694179769" watchObservedRunningTime="2026-07-01 17:17:18.921335757 +0000 UTC m=+60.694922563"
Jul 01 17:17:19.056087 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.056068    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:19.198413 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.198366    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-nvbdg"]
Jul 01 17:17:19.202419 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:19.202374    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e1f23f_3ae7_4588_a9b0_0af731271312.slice/crio-e89f315b44bc4a81aa0f0733cbe25d8f65152484b55cf64120d2a2b16f6ba8e7 WatchSource:0}: Error finding container e89f315b44bc4a81aa0f0733cbe25d8f65152484b55cf64120d2a2b16f6ba8e7: Status 404 returned error can't find the container with id e89f315b44bc4a81aa0f0733cbe25d8f65152484b55cf64120d2a2b16f6ba8e7
Jul 01 17:17:19.892946 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.892910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7k2s" event={"ID":"a8718870-34e5-469c-91dd-4b22e61820ef","Type":"ContainerStarted","Data":"2fec2c149468b29824ead63524650a7df0103a091b94368c99eba6399d268dbb"}
Jul 01 17:17:19.894279 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.894240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-nvbdg" event={"ID":"95e1f23f-3ae7-4588-a9b0-0af731271312","Type":"ContainerStarted","Data":"e89f315b44bc4a81aa0f0733cbe25d8f65152484b55cf64120d2a2b16f6ba8e7"}
Jul 01 17:17:19.896126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.896073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh" event={"ID":"f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0","Type":"ContainerStarted","Data":"38aa989b4c75954028714bb9b7f86122c51242a25b32cacd1fc2cfe7d103f09a"}
Jul 01 17:17:19.914380 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:19.914272    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh" podStartSLOduration=4.272069467 podStartE2EDuration="5.914249521s" totalImagesPullingTime="1.642180054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:19.913756922 +0000 UTC m=+61.687343740" watchObservedRunningTime="2026-07-01 17:17:19.914249521 +0000 UTC m=+61.687836327"
Jul 01 17:17:20.900358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:20.900308    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:20.906560 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:20.906531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-xwllh"
Jul 01 17:17:21.557767 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.557734    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"]
Jul 01 17:17:21.567997 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.567335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.570601 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.570571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"]
Jul 01 17:17:21.571729 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.571705    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 17:17:21.571977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.571958    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 01 17:17:21.572170 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.572158    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 17:17:21.572373 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.572360    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 01 17:17:21.573379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.572643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j8bsb\""
Jul 01 17:17:21.573379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.572848    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 17:17:21.671547 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.671503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.671741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.671558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4j62\" (UniqueName: \"kubernetes.io/projected/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-kube-api-access-x4j62\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.671741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.671611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.671741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.671632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.772228 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.772185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4j62\" (UniqueName: \"kubernetes.io/projected/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-kube-api-access-x4j62\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.772420 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.772250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.772420 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.772278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.772420 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.772349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.772613 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:21.772435    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 01 17:17:21.772613 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:21.772522    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls podName:8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead nodeName:}" failed. No retries permitted until 2026-07-01 17:17:22.272503945 +0000 UTC m=+64.046090729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-w4j5p" (UID: "8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead") : secret "prometheus-operator-tls" not found
Jul 01 17:17:21.773366 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.773336    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.775058 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.775034    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:21.781759 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:21.781741    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4j62\" (UniqueName: \"kubernetes.io/projected/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-kube-api-access-x4j62\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:22.276968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.276929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:22.279734 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.279709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-w4j5p\" (UID: \"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:22.479849 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.479810    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"
Jul 01 17:17:22.613858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.613822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-w4j5p"]
Jul 01 17:17:22.617856 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:22.617827    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd14a3d_e24c_4a16_ac37_eed8cdbf1ead.slice/crio-8d486e8452bc0c0bb7ce15749047fa91879413d92c4aa36ac2afa8a273b842b9 WatchSource:0}: Error finding container 8d486e8452bc0c0bb7ce15749047fa91879413d92c4aa36ac2afa8a273b842b9: Status 404 returned error can't find the container with id 8d486e8452bc0c0bb7ce15749047fa91879413d92c4aa36ac2afa8a273b842b9
Jul 01 17:17:22.909365 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.909275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p" event={"ID":"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead","Type":"ContainerStarted","Data":"8d486e8452bc0c0bb7ce15749047fa91879413d92c4aa36ac2afa8a273b842b9"}
Jul 01 17:17:22.911848 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.911821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7k2s" event={"ID":"a8718870-34e5-469c-91dd-4b22e61820ef","Type":"ContainerStarted","Data":"4e396a68eb9cf8464cba1a43fb6a6741fdaf3c60748d65873999a5e28eb981cf"}
Jul 01 17:17:22.933264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:22.933208    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t7k2s" podStartSLOduration=1.678102183 podStartE2EDuration="10.933191173s" totalImagesPullingTime="9.25508899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:17:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:22.93170251 +0000 UTC m=+64.705289317" watchObservedRunningTime="2026-07-01 17:17:22.933191173 +0000 UTC m=+64.706777977"
Jul 01 17:17:23.867357 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.867317    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:17:23.869272 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.869252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.873789 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 17:17:23.873789 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 17:17:23.873950 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873769    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 17:17:23.873950 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 17:17:23.873950 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 17:17:23.873950 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.873761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t5ndn\""
Jul 01 17:17:23.879800 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.879780    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:17:23.890567 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.890670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.890670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.890670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.890670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.890670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.890668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnnbh\" (UniqueName: \"kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991700 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991700 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.991944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.991799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnbh\" (UniqueName: \"kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.992802 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.992563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.993065 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.993037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.993406 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.993377    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.995377 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.995015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:23.995377 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:23.995328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:24.000518 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.000492    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnnbh\" (UniqueName: \"kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh\") pod \"console-564c7886c4-fwlt6\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") " pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:24.181442 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.181345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:24.394548 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.394511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:24.394715 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.394570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:24.397564 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.397542    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 17:17:24.397682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.397567    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 17:17:24.407203 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.407181    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd-original-pull-secret\") pod \"global-pull-secret-syncer-4hmvb\" (UID: \"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd\") " pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:24.407432 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.407409    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68690aef-39ff-420b-9b85-9ed5bab421c0-metrics-certs\") pod \"network-metrics-daemon-fbptr\" (UID: \"68690aef-39ff-420b-9b85-9ed5bab421c0\") " pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:24.537847 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.537817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:17:24.546675 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:24.546648    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5921ba79_e282_46bd_8048_2c6e202355f2.slice/crio-03bb30a2ada45af01f523de6c1aed9d449084b0dab375379494ddc365289da1b WatchSource:0}: Error finding container 03bb30a2ada45af01f523de6c1aed9d449084b0dab375379494ddc365289da1b: Status 404 returned error can't find the container with id 03bb30a2ada45af01f523de6c1aed9d449084b0dab375379494ddc365289da1b
Jul 01 17:17:24.596757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.596713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:24.599708 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.599687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 17:17:24.609437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.609413    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 17:17:24.620925 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.620885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28pk\" (UniqueName: \"kubernetes.io/projected/768e2e4c-2b81-4578-8676-9292a482fd2b-kube-api-access-s28pk\") pod \"network-check-target-wmjfv\" (UID: \"768e2e4c-2b81-4578-8676-9292a482fd2b\") " pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:24.667063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.667034    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hpmk\""
Jul 01 17:17:24.669465 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.669407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hmvb"
Jul 01 17:17:24.674763 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.674583    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbptr"
Jul 01 17:17:24.676974 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.676945    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x7ht4\""
Jul 01 17:17:24.685075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.684397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:24.842717 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.842669    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hmvb"]
Jul 01 17:17:24.848938 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:24.848664    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e5ec97_77e0_44e2_b78c_8e6d5a4265cd.slice/crio-16f614c95e432e924eded8c162e9aae90c6ccb0bc82c4092027589b4d6c952b1 WatchSource:0}: Error finding container 16f614c95e432e924eded8c162e9aae90c6ccb0bc82c4092027589b4d6c952b1: Status 404 returned error can't find the container with id 16f614c95e432e924eded8c162e9aae90c6ccb0bc82c4092027589b4d6c952b1
Jul 01 17:17:24.864034 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.864012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmjfv"]
Jul 01 17:17:24.867294 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:24.867266    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768e2e4c_2b81_4578_8676_9292a482fd2b.slice/crio-1c0118d3229269f7a5401cd06e8efe90e4c9cd6a55deda700a785c037d24af73 WatchSource:0}: Error finding container 1c0118d3229269f7a5401cd06e8efe90e4c9cd6a55deda700a785c037d24af73: Status 404 returned error can't find the container with id 1c0118d3229269f7a5401cd06e8efe90e4c9cd6a55deda700a785c037d24af73
Jul 01 17:17:24.881784 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.881756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbptr"]
Jul 01 17:17:24.886006 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:24.885972    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68690aef_39ff_420b_9b85_9ed5bab421c0.slice/crio-7cb3cee57c249979537acb4ee46d3289fe04a434321bd6a9475453ad1bf1a17e WatchSource:0}: Error finding container 7cb3cee57c249979537acb4ee46d3289fe04a434321bd6a9475453ad1bf1a17e: Status 404 returned error can't find the container with id 7cb3cee57c249979537acb4ee46d3289fe04a434321bd6a9475453ad1bf1a17e
Jul 01 17:17:24.919769 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.919736    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p" event={"ID":"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead","Type":"ContainerStarted","Data":"3f824c6578c475500263a9a2267a428e13639da75efee6934a3a659379df490f"}
Jul 01 17:17:24.919888 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.919815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p" event={"ID":"8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead","Type":"ContainerStarted","Data":"9a3b0cbffe8329e50bc4c100f2350fe1d4a900c9633de36084d4ddb4574b3a45"}
Jul 01 17:17:24.920791 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.920765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmjfv" event={"ID":"768e2e4c-2b81-4578-8676-9292a482fd2b","Type":"ContainerStarted","Data":"1c0118d3229269f7a5401cd06e8efe90e4c9cd6a55deda700a785c037d24af73"}
Jul 01 17:17:24.921894 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.921866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c7886c4-fwlt6" event={"ID":"5921ba79-e282-46bd-8048-2c6e202355f2","Type":"ContainerStarted","Data":"03bb30a2ada45af01f523de6c1aed9d449084b0dab375379494ddc365289da1b"}
Jul 01 17:17:24.922928 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.922899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbptr" event={"ID":"68690aef-39ff-420b-9b85-9ed5bab421c0","Type":"ContainerStarted","Data":"7cb3cee57c249979537acb4ee46d3289fe04a434321bd6a9475453ad1bf1a17e"}
Jul 01 17:17:24.923986 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.923956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hmvb" event={"ID":"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd","Type":"ContainerStarted","Data":"16f614c95e432e924eded8c162e9aae90c6ccb0bc82c4092027589b4d6c952b1"}
Jul 01 17:17:24.938209 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:24.938122    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-w4j5p" podStartSLOduration=2.132869528 podStartE2EDuration="3.938108168s" totalImagesPullingTime="1.80523864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:24.937164847 +0000 UTC m=+66.710751652" watchObservedRunningTime="2026-07-01 17:17:24.938108168 +0000 UTC m=+66.711694974"
Jul 01 17:17:26.909144 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.909115    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"]
Jul 01 17:17:26.916362 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.915611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:26.919152 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.918942    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 01 17:17:26.922481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.920306    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dl4f2\""
Jul 01 17:17:26.922481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.920616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 01 17:17:26.922481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.921149    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-ngsbg"]
Jul 01 17:17:26.925519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.924650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:26.928165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.927663    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qcfln\""
Jul 01 17:17:26.928165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.927872    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 01 17:17:26.928165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.928060    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 01 17:17:26.928632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.928617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 01 17:17:26.934368 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.934348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"]
Jul 01 17:17:26.943737 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.943709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbptr" event={"ID":"68690aef-39ff-420b-9b85-9ed5bab421c0","Type":"ContainerStarted","Data":"00ec95446c9f54855bde0fc087bcb2b998103b383d5f83c8e772d2d00d160d2f"}
Jul 01 17:17:26.943932 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.943908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbptr" event={"ID":"68690aef-39ff-420b-9b85-9ed5bab421c0","Type":"ContainerStarted","Data":"f5b6e47dd0ccd2ecb854def1c2a9c590b0aa4411252ae397f0a3e5624a5ab60e"}
Jul 01 17:17:26.944061 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.943945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-ngsbg"]
Jul 01 17:17:26.959502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.958129    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vrdw9"]
Jul 01 17:17:26.963006 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.962441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:26.965757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.965346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k49ht\""
Jul 01 17:17:26.965757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.965598    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 17:17:26.966179 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.966160    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 17:17:26.966415 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:26.966342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 17:17:27.001216 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.000582    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbptr" podStartSLOduration=67.74590894 podStartE2EDuration="1m9.000558973s" totalImagesPullingTime="1.254650033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:26.999734319 +0000 UTC m=+68.773321126" watchObservedRunningTime="2026-07-01 17:17:27.000558973 +0000 UTC m=+68.774145781"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-sys\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0731604d-3819-4ddc-ad69-81792e8b610a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-textfile\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-root\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-metrics-client-ca\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hpz4\" (UniqueName: \"kubernetes.io/projected/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-kube-api-access-5hpz4\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkb2\" (UniqueName: \"kubernetes.io/projected/0731604d-3819-4ddc-ad69-81792e8b610a-kube-api-access-rqkb2\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvc9m\" (UniqueName: \"kubernetes.io/projected/a3ef1740-466f-4fad-8cdd-8c056561feee-kube-api-access-zvc9m\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-wtmp\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.017705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.018755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.018755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.018755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.018755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.017749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.120675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-sys\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0731604d-3819-4ddc-ad69-81792e8b610a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-textfile\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-root\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.120858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-metrics-client-ca\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpz4\" (UniqueName: \"kubernetes.io/projected/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-kube-api-access-5hpz4\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkb2\" (UniqueName: \"kubernetes.io/projected/0731604d-3819-4ddc-ad69-81792e8b610a-kube-api-access-rqkb2\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvc9m\" (UniqueName: \"kubernetes.io/projected/a3ef1740-466f-4fad-8cdd-8c056561feee-kube-api-access-zvc9m\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.120999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-wtmp\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.121136 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.121617 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.121617 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.121617 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.121204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.122148 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.122103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.122642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.122614    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-root\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.122706 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.122678    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-sys\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.122759    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:27.122963    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.123009    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0731604d-3819-4ddc-ad69-81792e8b610a-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:27.123093    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls podName:a3ef1740-466f-4fad-8cdd-8c056561feee nodeName:}" failed. No retries permitted until 2026-07-01 17:17:27.62307107 +0000 UTC m=+69.396657857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls") pod "node-exporter-vrdw9" (UID: "a3ef1740-466f-4fad-8cdd-8c056561feee") : secret "node-exporter-tls" not found
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.123141    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-wtmp\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.123924 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.123271    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-textfile\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.125583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.124307    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0731604d-3819-4ddc-ad69-81792e8b610a-metrics-client-ca\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.125583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.125054    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-accelerators-collector-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.125583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.125515    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ef1740-466f-4fad-8cdd-8c056561feee-metrics-client-ca\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.127999 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.127875    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.128857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.128818    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.130207 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.130041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.130207 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.130167    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.130749 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.130709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0731604d-3819-4ddc-ad69-81792e8b610a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.139257 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.139211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvc9m\" (UniqueName: \"kubernetes.io/projected/a3ef1740-466f-4fad-8cdd-8c056561feee-kube-api-access-zvc9m\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.142835 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.142698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpz4\" (UniqueName: \"kubernetes.io/projected/f1de28c2-ec09-4e08-b82f-3ce78ff212dd-kube-api-access-5hpz4\") pod \"openshift-state-metrics-57f99c8b49-zvdrn\" (UID: \"f1de28c2-ec09-4e08-b82f-3ce78ff212dd\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.145281 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.145237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkb2\" (UniqueName: \"kubernetes.io/projected/0731604d-3819-4ddc-ad69-81792e8b610a-kube-api-access-rqkb2\") pod \"kube-state-metrics-845b954455-ngsbg\" (UID: \"0731604d-3819-4ddc-ad69-81792e8b610a\") " pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.241728 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.241612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"
Jul 01 17:17:27.251443 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.251368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg"
Jul 01 17:17:27.627125 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.626468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.630765 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.630671    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ef1740-466f-4fad-8cdd-8c056561feee-node-exporter-tls\") pod \"node-exporter-vrdw9\" (UID: \"a3ef1740-466f-4fad-8cdd-8c056561feee\") " pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:27.875739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:27.875524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vrdw9"
Jul 01 17:17:28.015070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.011416    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:17:28.029642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.029570    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:17:28.029807 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.029698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.036600 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 17:17:28.036744 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 17:17:28.036744 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036684    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 17:17:28.036880 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036651    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 17:17:28.036880 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-982jl\""
Jul 01 17:17:28.036880 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 17:17:28.037029 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 17:17:28.037029 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.036951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 17:17:28.037161 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.037043    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 17:17:28.037218 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.037177    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 17:17:28.133500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.133992 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.133881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrxh\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.234919 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.234919 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.234996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235166 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235565 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235565 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.235565 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.235249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrxh\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.237126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.237076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.238350 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.238239    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.238647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.238582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.244228 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.244173    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.244435 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.244408    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.245285 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.245191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.245285 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.245213    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrxh\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.245431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.245401    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.246639 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.246613    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.247645 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.247601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.248089 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.248050    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.251074 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.251048    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.254103 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.254062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.347095 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.347061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:17:28.901573 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.901540    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-629b7"
Jul 01 17:17:28.915368 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.915327    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"]
Jul 01 17:17:28.918474 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.918425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921700    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921758    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ulrqkg44410o\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.921701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 01 17:17:28.922168 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.922049    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7s2t6\""
Jul 01 17:17:28.932559 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:28.932504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"]
Jul 01 17:17:29.042344 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-metrics-client-ca\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-grpc-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd8hd\" (UniqueName: \"kubernetes.io/projected/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-kube-api-access-xd8hd\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.042837 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.042612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144012 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.143974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144012 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144271 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-metrics-client-ca\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144271 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-grpc-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144377 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd8hd\" (UniqueName: \"kubernetes.io/projected/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-kube-api-access-xd8hd\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144377 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.144519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.144414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.145277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.145006    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-metrics-client-ca\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.148036 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.147979    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.149127 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.148679    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.149127 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.148703    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.149127 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.148851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-grpc-tls\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.149127 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.149091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.150015 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.149987    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.157649 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.157550    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd8hd\" (UniqueName: \"kubernetes.io/projected/74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a-kube-api-access-xd8hd\") pod \"thanos-querier-7bffbb96f5-gcsdx\" (UID: \"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a\") " pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:29.235157 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:29.235108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:31.241386 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.241344    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-644ccfb987-9gsvt"]
Jul 01 17:17:31.245696 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.245668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.249820 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.249786    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 01 17:17:31.249820 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.249817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 01 17:17:31.250066 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.250050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 01 17:17:31.250113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.250081    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-52g8f\""
Jul 01 17:17:31.250113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.250099    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1530v2c30rhh1\""
Jul 01 17:17:31.250226 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.250214    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 01 17:17:31.253002 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.252974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644ccfb987-9gsvt"]
Jul 01 17:17:31.366467 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-metrics-server-audit-profiles\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-audit-log\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-client-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-tls\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sq5t\" (UniqueName: \"kubernetes.io/projected/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-kube-api-access-8sq5t\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.366868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.366715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-client-certs\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467729 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sq5t\" (UniqueName: \"kubernetes.io/projected/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-kube-api-access-8sq5t\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-client-certs\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-metrics-server-audit-profiles\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-audit-log\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-client-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.467943 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.467943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-tls\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.469477 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.469428    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-audit-log\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.470315 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.470283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.471131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.471098    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-metrics-server-audit-profiles\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.471671 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.471625    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-client-certs\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.471779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.471703    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-secret-metrics-server-tls\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.474827 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.474799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-client-ca-bundle\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.478993 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.478959    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sq5t\" (UniqueName: \"kubernetes.io/projected/463f249a-2de3-488f-9ec4-f4e2e84e0c7d-kube-api-access-8sq5t\") pod \"metrics-server-644ccfb987-9gsvt\" (UID: \"463f249a-2de3-488f-9ec4-f4e2e84e0c7d\") " pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.559063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.559027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:31.684833 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:31.684783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ef1740_466f_4fad_8cdd_8c056561feee.slice/crio-ffd071c2cd8f1febf68eab50ea8c63851dad8fd222cf2e097814d4b6ee1ce954 WatchSource:0}: Error finding container ffd071c2cd8f1febf68eab50ea8c63851dad8fd222cf2e097814d4b6ee1ce954: Status 404 returned error can't find the container with id ffd071c2cd8f1febf68eab50ea8c63851dad8fd222cf2e097814d4b6ee1ce954
Jul 01 17:17:31.700939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.700910    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"]
Jul 01 17:17:31.705792 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.705673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.709739 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.709524    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b2ttc\""
Jul 01 17:17:31.709884 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.709818    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 01 17:17:31.713482 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.712172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"]
Jul 01 17:17:31.775037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.772097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.775037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.772162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp52j\" (UniqueName: \"kubernetes.io/projected/423ab4ab-5f47-4148-a25a-80530236f7ee-kube-api-access-hp52j\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.873598 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.872732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.873598 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.872792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp52j\" (UniqueName: \"kubernetes.io/projected/423ab4ab-5f47-4148-a25a-80530236f7ee-kube-api-access-hp52j\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.873598 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:31.873309    2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 01 17:17:31.873598 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:17:31.873377    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert podName:423ab4ab-5f47-4148-a25a-80530236f7ee nodeName:}" failed. No retries permitted until 2026-07-01 17:17:32.373353333 +0000 UTC m=+74.146940121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-nt5qz" (UID: "423ab4ab-5f47-4148-a25a-80530236f7ee") : secret "monitoring-plugin-cert" not found
Jul 01 17:17:31.892035 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.891762    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp52j\" (UniqueName: \"kubernetes.io/projected/423ab4ab-5f47-4148-a25a-80530236f7ee-kube-api-access-hp52j\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:31.978044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.974747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-ngsbg"]
Jul 01 17:17:31.985436 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:31.985390    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0731604d_3819_4ddc_ad69_81792e8b610a.slice/crio-018455d6610e0707ecdb1558eb33a9fb8e6966a38fbee25645d1f40ed4958e27 WatchSource:0}: Error finding container 018455d6610e0707ecdb1558eb33a9fb8e6966a38fbee25645d1f40ed4958e27: Status 404 returned error can't find the container with id 018455d6610e0707ecdb1558eb33a9fb8e6966a38fbee25645d1f40ed4958e27
Jul 01 17:17:31.989133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.988548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmjfv" event={"ID":"768e2e4c-2b81-4578-8676-9292a482fd2b","Type":"ContainerStarted","Data":"06354778731a38b3e18d8518492d3adf9b33b543dbb907c8444530087c1829f7"}
Jul 01 17:17:31.989133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.988956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:17:31.995305 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.993428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c7886c4-fwlt6" event={"ID":"5921ba79-e282-46bd-8048-2c6e202355f2","Type":"ContainerStarted","Data":"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"}
Jul 01 17:17:31.998485 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:31.997489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:17:32.003027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.002704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrdw9" event={"ID":"a3ef1740-466f-4fad-8cdd-8c056561feee","Type":"ContainerStarted","Data":"ffd071c2cd8f1febf68eab50ea8c63851dad8fd222cf2e097814d4b6ee1ce954"}
Jul 01 17:17:32.019360 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.018924    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wmjfv" podStartSLOduration=67.196075845 podStartE2EDuration="1m14.018903317s" totalImagesPullingTime="6.822827472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:32.009113307 +0000 UTC m=+73.782700116" watchObservedRunningTime="2026-07-01 17:17:32.018903317 +0000 UTC m=+73.792490115"
Jul 01 17:17:32.021696 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.021495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn"]
Jul 01 17:17:32.024974 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:32.024904    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1de28c2_ec09_4e08_b82f_3ce78ff212dd.slice/crio-52e46cd141a6ab127146bb4ad28e8217cb98c6fd038033ff51c9fe71030677f5 WatchSource:0}: Error finding container 52e46cd141a6ab127146bb4ad28e8217cb98c6fd038033ff51c9fe71030677f5: Status 404 returned error can't find the container with id 52e46cd141a6ab127146bb4ad28e8217cb98c6fd038033ff51c9fe71030677f5
Jul 01 17:17:32.032304 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.032248    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564c7886c4-fwlt6" podStartSLOduration=1.890088522 podStartE2EDuration="9.032223874s" totalImagesPullingTime="7.142135352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:32.030425472 +0000 UTC m=+73.804012277" watchObservedRunningTime="2026-07-01 17:17:32.032223874 +0000 UTC m=+73.805810682"
Jul 01 17:17:32.051742 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.050187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644ccfb987-9gsvt"]
Jul 01 17:17:32.051742 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.050757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"]
Jul 01 17:17:32.051742 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:32.050894    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463f249a_2de3_488f_9ec4_f4e2e84e0c7d.slice/crio-a4d7c09dd98e426e5761d87e584a4aa87f69c59f7052700ddfb99a13a488f188 WatchSource:0}: Error finding container a4d7c09dd98e426e5761d87e584a4aa87f69c59f7052700ddfb99a13a488f188: Status 404 returned error can't find the container with id a4d7c09dd98e426e5761d87e584a4aa87f69c59f7052700ddfb99a13a488f188
Jul 01 17:17:32.055246 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:32.055211    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f3d02c_62b5_4f29_8d2c_ad5afe34ae0a.slice/crio-294647498d3ddb57a8d0667fd48b5ced6323b62262f58d3c2d367ba70f4c389f WatchSource:0}: Error finding container 294647498d3ddb57a8d0667fd48b5ced6323b62262f58d3c2d367ba70f4c389f: Status 404 returned error can't find the container with id 294647498d3ddb57a8d0667fd48b5ced6323b62262f58d3c2d367ba70f4c389f
Jul 01 17:17:32.378473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.378311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:32.381538 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.381468    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/423ab4ab-5f47-4148-a25a-80530236f7ee-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-nt5qz\" (UID: \"423ab4ab-5f47-4148-a25a-80530236f7ee\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:32.628300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.628025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:32.802440 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:32.802397    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"]
Jul 01 17:17:33.013480 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.013422    2582 generic.go:356] "Generic (PLEG): container finished" podID="a3ef1740-466f-4fad-8cdd-8c056561feee" containerID="d56106627b46262d6aeadf41d4680f8954f10e9372f7552466bd6ab748f8eb98" exitCode=0
Jul 01 17:17:33.013878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.013786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrdw9" event={"ID":"a3ef1740-466f-4fad-8cdd-8c056561feee","Type":"ContainerDied","Data":"d56106627b46262d6aeadf41d4680f8954f10e9372f7552466bd6ab748f8eb98"}
Jul 01 17:17:33.015977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.015894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz" event={"ID":"423ab4ab-5f47-4148-a25a-80530236f7ee","Type":"ContainerStarted","Data":"e6eb39bfad917979ac645345d89a44f9048a4e3902a7be14e30f84e561f890ee"}
Jul 01 17:17:33.019001 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.018892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"9b3a3708c385ea0a2c4c15a278e49436255cacb445617ca0df4aa5e101a0ad25"}
Jul 01 17:17:33.022673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.022580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"294647498d3ddb57a8d0667fd48b5ced6323b62262f58d3c2d367ba70f4c389f"}
Jul 01 17:17:33.026394 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.025788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hmvb" event={"ID":"b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd","Type":"ContainerStarted","Data":"bafc4bfac1edf85eb64631445b242a479698de6928fd6f2325ec5e938d44b102"}
Jul 01 17:17:33.035439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.035278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn" event={"ID":"f1de28c2-ec09-4e08-b82f-3ce78ff212dd","Type":"ContainerStarted","Data":"37831565d76aabd7db8389a1b07a03c7316683f17fc00fa43f9c06620e2684c3"}
Jul 01 17:17:33.035439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.035353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn" event={"ID":"f1de28c2-ec09-4e08-b82f-3ce78ff212dd","Type":"ContainerStarted","Data":"0bd5743b22bfb1df6b0a9f5680e50fd406de819c81cd7bcb6789b1c0e9838696"}
Jul 01 17:17:33.035439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.035383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn" event={"ID":"f1de28c2-ec09-4e08-b82f-3ce78ff212dd","Type":"ContainerStarted","Data":"52e46cd141a6ab127146bb4ad28e8217cb98c6fd038033ff51c9fe71030677f5"}
Jul 01 17:17:33.040566 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.040442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg" event={"ID":"0731604d-3819-4ddc-ad69-81792e8b610a","Type":"ContainerStarted","Data":"018455d6610e0707ecdb1558eb33a9fb8e6966a38fbee25645d1f40ed4958e27"}
Jul 01 17:17:33.046843 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.046266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt" event={"ID":"463f249a-2de3-488f-9ec4-f4e2e84e0c7d","Type":"ContainerStarted","Data":"a4d7c09dd98e426e5761d87e584a4aa87f69c59f7052700ddfb99a13a488f188"}
Jul 01 17:17:33.055362 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.055299    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4hmvb" podStartSLOduration=68.219242692 podStartE2EDuration="1m15.055274526s" totalImagesPullingTime="6.836031834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:33.054024962 +0000 UTC m=+74.827611768" watchObservedRunningTime="2026-07-01 17:17:33.055274526 +0000 UTC m=+74.828861329"
Jul 01 17:17:33.271040 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.270270    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:17:33.279731 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.277429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.282307 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.282097    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 01 17:17:33.283209 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.283074    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 01 17:17:33.285108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.283830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xgrbm\""
Jul 01 17:17:33.285108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.284147    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 01 17:17:33.285108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.284343    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 01 17:17:33.285108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.284570    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 01 17:17:33.285108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.284845    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 01 17:17:33.286223 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.285763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5659l1h7o91hs\""
Jul 01 17:17:33.291874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.290389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 01 17:17:33.291874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.290764    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 01 17:17:33.291874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.290951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 01 17:17:33.291874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.291118    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 01 17:17:33.291874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.291381    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 01 17:17:33.294526 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.293667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 01 17:17:33.294526 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.294136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 01 17:17:33.300894 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.300868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:17:33.301469 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.301426    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tqx\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.392637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.391996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.393944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.392084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.393944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.392121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.393944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.392172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.393944 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.392206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.502978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tqx\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.503481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.504532 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.504532 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.504532 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.503303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.507556 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.505708    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.507556 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.507224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.509679 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.508711    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.511201 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.511174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.513179 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.512193    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.513319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.512407    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.513437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.512544    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.513566 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.513273    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.526588 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.526430    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.526826 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.526796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.527726 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.527012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.527726 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.527471    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.528660 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.528607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.528968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.528921    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.529200 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.529146    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.529418 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.529395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.532580 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.532367    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.534100 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.533925    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.534239 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.534113    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.537643 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.537579    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tqx\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx\") pod \"prometheus-k8s-0\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.599123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.598750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:17:33.838765 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:33.838062    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:17:34.063595 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.063562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrdw9" event={"ID":"a3ef1740-466f-4fad-8cdd-8c056561feee","Type":"ContainerStarted","Data":"56c1c36964d53c82859cba7671afcd7a91c0929af78e303e8ca4be62cd0496c3"}
Jul 01 17:17:34.063780 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.063619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vrdw9" event={"ID":"a3ef1740-466f-4fad-8cdd-8c056561feee","Type":"ContainerStarted","Data":"ce49487583eba1ffca55c89c19921530d3515a91f9405a78c6a09b9f77d5cec2"}
Jul 01 17:17:34.082774 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.082692    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vrdw9" podStartSLOduration=6.998203441 podStartE2EDuration="8.082667404s" totalImagesPullingTime="990.681843ms" totalInitContainerRuntime="93.78212ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:34.081308129 +0000 UTC m=+75.854894936" watchObservedRunningTime="2026-07-01 17:17:34.082667404 +0000 UTC m=+75.856254209"
Jul 01 17:17:34.182099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.182004    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:34.182099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.182087    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:34.190736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:34.190464    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:34.583021 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:17:34.582970    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905591ef_87f5_4ecf_a883_33c6dd4c174e.slice/crio-40c007b686d539a89ee58afae81715b76f0ac27144dc3032ffe177d33e714dcc WatchSource:0}: Error finding container 40c007b686d539a89ee58afae81715b76f0ac27144dc3032ffe177d33e714dcc: Status 404 returned error can't find the container with id 40c007b686d539a89ee58afae81715b76f0ac27144dc3032ffe177d33e714dcc
Jul 01 17:17:35.067903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:35.067866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"40c007b686d539a89ee58afae81715b76f0ac27144dc3032ffe177d33e714dcc"}
Jul 01 17:17:35.073121 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:35.073094    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:17:44.113983 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.113912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn" event={"ID":"f1de28c2-ec09-4e08-b82f-3ce78ff212dd","Type":"ContainerStarted","Data":"2eadc8ae73387250b9abfee754eb27b6a6ad283a08e187193c6923ef32c35c50"}
Jul 01 17:17:44.117719 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.117250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg" event={"ID":"0731604d-3819-4ddc-ad69-81792e8b610a","Type":"ContainerStarted","Data":"4fcca3456b493e5e0885524cfea1e77794bdf5f6caf807347c8b004354e6c4e7"}
Jul 01 17:17:44.121220 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.121106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt" event={"ID":"463f249a-2de3-488f-9ec4-f4e2e84e0c7d","Type":"ContainerStarted","Data":"0233ab017fc62e072a47f991d69a05b3085d145d7cfd047024e5f621453671e0"}
Jul 01 17:17:44.124624 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.124598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz" event={"ID":"423ab4ab-5f47-4148-a25a-80530236f7ee","Type":"ContainerStarted","Data":"10a03a42b282b27fce1c8ebbed03c023cc6f750ba4117b813f88c4faac365d8c"}
Jul 01 17:17:44.126916 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.126887    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d" exitCode=0
Jul 01 17:17:44.127040 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.126974    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d"}
Jul 01 17:17:44.132793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.132527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"32b43d250cf653e18ece408c82c3733c71cd2e9cc70f0e06babd24439b01fdfd"}
Jul 01 17:17:44.148991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.148930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-zvdrn" podStartSLOduration=6.708511944 podStartE2EDuration="18.14890407s" totalImagesPullingTime="11.440392126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:44.146934623 +0000 UTC m=+85.920521456" watchObservedRunningTime="2026-07-01 17:17:44.14890407 +0000 UTC m=+85.922490878"
Jul 01 17:17:44.156843 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.156817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:44.163771 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.163371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz"
Jul 01 17:17:44.206029 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.205948    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt" podStartSLOduration=1.625901161 podStartE2EDuration="13.205922679s" totalImagesPullingTime="11.580021518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:44.203661512 +0000 UTC m=+85.977248317" watchObservedRunningTime="2026-07-01 17:17:44.205922679 +0000 UTC m=+85.979509485"
Jul 01 17:17:44.252292 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.250517    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-nt5qz" podStartSLOduration=2.426845322 podStartE2EDuration="13.250493756s" totalImagesPullingTime="10.823648434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:44.246829627 +0000 UTC m=+86.020416489" watchObservedRunningTime="2026-07-01 17:17:44.250493756 +0000 UTC m=+86.024080545"
Jul 01 17:17:44.635474 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:44.620656    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:17:45.147294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.147227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"078be8503a44cc15ea15294296b17fadd46c5c71f9ce3d4241334deab181ff53"}
Jul 01 17:17:45.147824 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.147322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"274997a9174b8c7e26baf6a2c2c6698b30f78789a12ef238f73e26e00a97635d"}
Jul 01 17:17:45.149797 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.149751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-nvbdg" event={"ID":"95e1f23f-3ae7-4588-a9b0-0af731271312","Type":"ContainerStarted","Data":"8cd762f44534ffbc88ff82b47285337e7c932daad50b4cbcf0cbbdcfc6c1e60f"}
Jul 01 17:17:45.150173 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.150141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:45.154731 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.154690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg" event={"ID":"0731604d-3819-4ddc-ad69-81792e8b610a","Type":"ContainerStarted","Data":"8bb692018491b4ae1ebbfb070fef08d2adbc8ea1c20ae50b0965775ca49e3b12"}
Jul 01 17:17:45.154881 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.154769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg" event={"ID":"0731604d-3819-4ddc-ad69-81792e8b610a","Type":"ContainerStarted","Data":"439d03bdc1ccc41f0c27b3b6010f3178ae8e5fd9afbb62056c93461b490682a2"}
Jul 01 17:17:45.160236 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.159029    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7" exitCode=0
Jul 01 17:17:45.160236 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.159332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"}
Jul 01 17:17:45.162883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.162859    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-nvbdg"
Jul 01 17:17:45.173471 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:45.173398    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-nvbdg" podStartSLOduration=2.379656534 podStartE2EDuration="27.1733799s" totalImagesPullingTime="24.793723366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:45.170690771 +0000 UTC m=+86.944277578" watchObservedRunningTime="2026-07-01 17:17:45.1733799 +0000 UTC m=+86.946966706"
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"}
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"}
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"}
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"}
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"}
Jul 01 17:17:48.183684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.183619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerStarted","Data":"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"}
Jul 01 17:17:48.190241 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.189335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"f46561a5c9f7395b4fcda8d424f9b2c2d741fa6a0e1adca06ca1b450b60b92ad"}
Jul 01 17:17:48.190241 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.189420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"020af1035990194e3c9827368773cb3eb0795dd02fb7f8d7283131ccc57afe85"}
Jul 01 17:17:48.190241 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.189488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" event={"ID":"74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a","Type":"ContainerStarted","Data":"16c27a169e7fa0631dd82a1e73270b08259c37e823270f91e9db69d77e7a5f9f"}
Jul 01 17:17:48.190241 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.189688    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:48.217530 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.217471    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx" podStartSLOduration=5.787476607 podStartE2EDuration="20.217427897s" totalImagesPullingTime="14.42995129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:48.215004058 +0000 UTC m=+89.988590901" watchObservedRunningTime="2026-07-01 17:17:48.217427897 +0000 UTC m=+89.991014892"
Jul 01 17:17:48.219536 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:48.219080    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-ngsbg" podStartSLOduration=10.583343711 podStartE2EDuration="22.219060578s" totalImagesPullingTime="11.635716867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:45.247688 +0000 UTC m=+87.021274805" watchObservedRunningTime="2026-07-01 17:17:48.219060578 +0000 UTC m=+89.992647382"
Jul 01 17:17:49.204437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:49.204338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bffbb96f5-gcsdx"
Jul 01 17:17:49.233227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:49.233159    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.52635194 podStartE2EDuration="22.233133574s" totalImagesPullingTime="14.681139161s" totalInitContainerRuntime="25.642473ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:49.230754152 +0000 UTC m=+91.004340985" watchObservedRunningTime="2026-07-01 17:17:49.233133574 +0000 UTC m=+91.006720381"
Jul 01 17:17:51.210575 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"}
Jul 01 17:17:51.210575 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"}
Jul 01 17:17:51.211097 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"}
Jul 01 17:17:51.211097 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"}
Jul 01 17:17:51.211097 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"}
Jul 01 17:17:51.211097 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.210709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerStarted","Data":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"}
Jul 01 17:17:51.245431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.245363    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.5544912379999998 podStartE2EDuration="18.245336672s" totalImagesPullingTime="14.653236792s" totalInitContainerRuntime="37.608642ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:51.241329554 +0000 UTC m=+93.014916360" watchObservedRunningTime="2026-07-01 17:17:51.245336672 +0000 UTC m=+93.018923479"
Jul 01 17:17:51.559485 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.559428    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:51.559737 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:51.559527    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:17:53.599504 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:17:53.599436    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:03.049599 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:03.049559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wmjfv"
Jul 01 17:18:09.654868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:09.654827    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-564c7886c4-fwlt6" podUID="5921ba79-e282-46bd-8048-2c6e202355f2" containerName="console" containerID="cri-o://48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b" gracePeriod=15
Jul 01 17:18:09.932605 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:09.932521    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:18:10.088319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088280    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088322    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnnbh\" (UniqueName: \"kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088365    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088421    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert\") pod \"5921ba79-e282-46bd-8048-2c6e202355f2\" (UID: \"5921ba79-e282-46bd-8048-2c6e202355f2\") "
Jul 01 17:18:10.088888 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088852    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:10.088956 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088861    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:10.088956 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.088925    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config" (OuterVolumeSpecName: "console-config") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:10.091128 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.091102    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:10.091243 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.091157    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh" (OuterVolumeSpecName: "kube-api-access-fnnbh") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "kube-api-access-fnnbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:18:10.091243 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.091172    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5921ba79-e282-46bd-8048-2c6e202355f2" (UID: "5921ba79-e282-46bd-8048-2c6e202355f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189323    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-console-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189357    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-serving-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189367    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5921ba79-e282-46bd-8048-2c6e202355f2-console-oauth-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189376    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnnbh\" (UniqueName: \"kubernetes.io/projected/5921ba79-e282-46bd-8048-2c6e202355f2-kube-api-access-fnnbh\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189386    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-service-ca\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.189410 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.189393    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5921ba79-e282-46bd-8048-2c6e202355f2-oauth-serving-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:10.291648 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.291610    2582 generic.go:356] "Generic (PLEG): container finished" podID="5921ba79-e282-46bd-8048-2c6e202355f2" containerID="48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b" exitCode=0
Jul 01 17:18:10.291825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.291667    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c7886c4-fwlt6"
Jul 01 17:18:10.291825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.291715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c7886c4-fwlt6" event={"ID":"5921ba79-e282-46bd-8048-2c6e202355f2","Type":"ContainerDied","Data":"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"}
Jul 01 17:18:10.291825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.291787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c7886c4-fwlt6" event={"ID":"5921ba79-e282-46bd-8048-2c6e202355f2","Type":"ContainerDied","Data":"03bb30a2ada45af01f523de6c1aed9d449084b0dab375379494ddc365289da1b"}
Jul 01 17:18:10.291825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.291817    2582 scope.go:117] "RemoveContainer" containerID="48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"
Jul 01 17:18:10.301753 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.301733    2582 scope.go:117] "RemoveContainer" containerID="48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"
Jul 01 17:18:10.302066 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:10.302047    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b\": container with ID starting with 48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b not found: ID does not exist" containerID="48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"
Jul 01 17:18:10.302113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.302077    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b"} err="failed to get container status \"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b\": rpc error: code = NotFound desc = could not find container \"48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b\": container with ID starting with 48e00964c1f802c06221d9403bc931ff4d5d2049c14d7d51dc3c9071cba28e6b not found: ID does not exist"
Jul 01 17:18:10.313412 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.313377    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:18:10.317746 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.317718    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564c7886c4-fwlt6"]
Jul 01 17:18:10.660483 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:10.660424    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5921ba79-e282-46bd-8048-2c6e202355f2" path="/var/lib/kubelet/pods/5921ba79-e282-46bd-8048-2c6e202355f2/volumes"
Jul 01 17:18:11.565591 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:11.565559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:18:11.569981 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:11.569953    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-644ccfb987-9gsvt"
Jul 01 17:18:33.599734 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:33.599688    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:33.666273 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:33.666243    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:34.410417 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:34.410384    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:47.193845 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.193807    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194109    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="alertmanager" containerID="cri-o://81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163" gracePeriod=120
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194206    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy" containerID="cri-o://f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2" gracePeriod=120
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194256    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="config-reloader" containerID="cri-o://4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193" gracePeriod=120
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194260    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="prom-label-proxy" containerID="cri-o://4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b" gracePeriod=120
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194192    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-metric" containerID="cri-o://e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c" gracePeriod=120
Jul 01 17:18:47.194403 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.194206    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-web" containerID="cri-o://13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582" gracePeriod=120
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449646    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b" exitCode=0
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449682    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c" exitCode=0
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449691    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2" exitCode=0
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449698    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193" exitCode=0
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449703    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163" exitCode=0
Jul 01 17:18:47.449748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"}
Jul 01 17:18:47.450088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"}
Jul 01 17:18:47.450088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"}
Jul 01 17:18:47.450088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"}
Jul 01 17:18:47.450088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:47.449907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"}
Jul 01 17:18:48.442511 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.442481    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.457294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.457256    2582 generic.go:356] "Generic (PLEG): container finished" podID="39308b84-12a7-4068-9edc-f43a9d408324" containerID="13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582" exitCode=0
Jul 01 17:18:48.457479 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.457335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"}
Jul 01 17:18:48.457479 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.457346    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.457479 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.457473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"39308b84-12a7-4068-9edc-f43a9d408324","Type":"ContainerDied","Data":"9b3a3708c385ea0a2c4c15a278e49436255cacb445617ca0df4aa5e101a0ad25"}
Jul 01 17:18:48.457604 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.457527    2582 scope.go:117] "RemoveContainer" containerID="4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"
Jul 01 17:18:48.465227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.465209    2582 scope.go:117] "RemoveContainer" containerID="e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"
Jul 01 17:18:48.472728 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.472598    2582 scope.go:117] "RemoveContainer" containerID="f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"
Jul 01 17:18:48.482769 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.482738    2582 scope.go:117] "RemoveContainer" containerID="13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"
Jul 01 17:18:48.494214 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.494176    2582 scope.go:117] "RemoveContainer" containerID="4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"
Jul 01 17:18:48.502889 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.502870    2582 scope.go:117] "RemoveContainer" containerID="81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"
Jul 01 17:18:48.511925 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.511906    2582 scope.go:117] "RemoveContainer" containerID="72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d"
Jul 01 17:18:48.520391 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.520369    2582 scope.go:117] "RemoveContainer" containerID="4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"
Jul 01 17:18:48.520761 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.520743    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b\": container with ID starting with 4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b not found: ID does not exist" containerID="4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"
Jul 01 17:18:48.520834 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.520771    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b"} err="failed to get container status \"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b\": rpc error: code = NotFound desc = could not find container \"4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b\": container with ID starting with 4bfc59b6478e5158f20b5519ad8e136d989aee4f5aa63b1af8d7e9b01463055b not found: ID does not exist"
Jul 01 17:18:48.520834 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.520793    2582 scope.go:117] "RemoveContainer" containerID="e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"
Jul 01 17:18:48.521075 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.521060    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c\": container with ID starting with e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c not found: ID does not exist" containerID="e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"
Jul 01 17:18:48.521155 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521079    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c"} err="failed to get container status \"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c\": rpc error: code = NotFound desc = could not find container \"e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c\": container with ID starting with e63b4410b4507bc4cbde1664df448e955dd9317026418a6a3c6cf161c98b386c not found: ID does not exist"
Jul 01 17:18:48.521155 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521092    2582 scope.go:117] "RemoveContainer" containerID="f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"
Jul 01 17:18:48.521322 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.521306    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2\": container with ID starting with f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2 not found: ID does not exist" containerID="f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"
Jul 01 17:18:48.521363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521324    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2"} err="failed to get container status \"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2\": rpc error: code = NotFound desc = could not find container \"f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2\": container with ID starting with f63469112db95f9db24c228600d9afb1613a13af9f0aa7db26f6d8c4007021e2 not found: ID does not exist"
Jul 01 17:18:48.521363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521337    2582 scope.go:117] "RemoveContainer" containerID="13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"
Jul 01 17:18:48.521616 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.521598    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582\": container with ID starting with 13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582 not found: ID does not exist" containerID="13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"
Jul 01 17:18:48.521675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521624    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582"} err="failed to get container status \"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582\": rpc error: code = NotFound desc = could not find container \"13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582\": container with ID starting with 13f95a8b6598f1fb50bd207262378fd666e4cf72d13970cbdc9f32654bc01582 not found: ID does not exist"
Jul 01 17:18:48.521675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521641    2582 scope.go:117] "RemoveContainer" containerID="4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"
Jul 01 17:18:48.521875 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.521858    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193\": container with ID starting with 4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193 not found: ID does not exist" containerID="4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"
Jul 01 17:18:48.521926 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521880    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193"} err="failed to get container status \"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193\": rpc error: code = NotFound desc = could not find container \"4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193\": container with ID starting with 4d1e9fcb87a71d6e42d6d07a7d9ab57d71d711587dc8c20238b821b348ef9193 not found: ID does not exist"
Jul 01 17:18:48.521926 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.521893    2582 scope.go:117] "RemoveContainer" containerID="81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"
Jul 01 17:18:48.522113 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.522093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163\": container with ID starting with 81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163 not found: ID does not exist" containerID="81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"
Jul 01 17:18:48.522154 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.522121    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163"} err="failed to get container status \"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163\": rpc error: code = NotFound desc = could not find container \"81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163\": container with ID starting with 81bf20f20c4fb0972008722cea37a16f2544e8568d1ba5a939351c6dde054163 not found: ID does not exist"
Jul 01 17:18:48.522154 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.522138    2582 scope.go:117] "RemoveContainer" containerID="72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d"
Jul 01 17:18:48.522396 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:48.522372    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d\": container with ID starting with 72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d not found: ID does not exist" containerID="72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d"
Jul 01 17:18:48.522471 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.522401    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d"} err="failed to get container status \"72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d\": rpc error: code = NotFound desc = could not find container \"72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d\": container with ID starting with 72b4ca9589879f8250343910a405e7f0cf0ddb6f5e6bdd0db7f46119252bd74d not found: ID does not exist"
Jul 01 17:18:48.546100 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546061    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546100 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546136    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546191    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546247    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmrxh\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546319    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546367    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.546711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546445    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web\") pod \"39308b84-12a7-4068-9edc-f43a9d408324\" (UID: \"39308b84-12a7-4068-9edc-f43a9d408324\") "
Jul 01 17:18:48.547074 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.546870    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:48.547671 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.547631    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:48.547794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.547663    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:18:48.550187 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.550136    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.550675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.550652    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh" (OuterVolumeSpecName: "kube-api-access-hmrxh") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "kube-api-access-hmrxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:18:48.550830 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.550806    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.551005 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.550949    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.551110 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.551039    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume" (OuterVolumeSpecName: "config-volume") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.551173 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.551124    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.551392 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.551369    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:18:48.551741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.551725    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out" (OuterVolumeSpecName: "config-out") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:18:48.554816 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.554774    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.561358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.561329    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config" (OuterVolumeSpecName: "web-config") pod "39308b84-12a7-4068-9edc-f43a9d408324" (UID: "39308b84-12a7-4068-9edc-f43a9d408324"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:48.647326 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647286    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647326 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647323    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-cluster-tls-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647358    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-web-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647368    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647377    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-config-volume\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647387    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-config-out\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647398    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647411    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmrxh\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-kube-api-access-hmrxh\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647420    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-metrics-client-ca\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647429    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647437    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/39308b84-12a7-4068-9edc-f43a9d408324-secret-alertmanager-main-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647445    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39308b84-12a7-4068-9edc-f43a9d408324-tls-assets\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.647578 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.647472    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/39308b84-12a7-4068-9edc-f43a9d408324-alertmanager-main-db\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:48.777099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.777063    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:48.780331 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.780304    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:48.807256 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807223    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:48.807583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807568    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="prom-label-proxy"
Jul 01 17:18:48.807583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807584    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="prom-label-proxy"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807597    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="config-reloader"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807603    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="config-reloader"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807609    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807614    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807623    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5921ba79-e282-46bd-8048-2c6e202355f2" containerName="console"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807629    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5921ba79-e282-46bd-8048-2c6e202355f2" containerName="console"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807641    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="init-config-reloader"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807647    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="init-config-reloader"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="alertmanager"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807657    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="alertmanager"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807662    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-metric"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807667    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-metric"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807675    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-web"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807681    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-web"
Jul 01 17:18:48.807736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807738    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5921ba79-e282-46bd-8048-2c6e202355f2" containerName="console"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807751    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-web"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807760    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807770    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="config-reloader"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807779    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="prom-label-proxy"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807787    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="alertmanager"
Jul 01 17:18:48.808212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.807793    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39308b84-12a7-4068-9edc-f43a9d408324" containerName="kube-rbac-proxy-metric"
Jul 01 17:18:48.811783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.811758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.814539 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814507    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 17:18:48.814539 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814524    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 17:18:48.814740 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814592    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 17:18:48.814740 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814620    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 17:18:48.814957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 17:18:48.815045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814959    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-982jl\""
Jul 01 17:18:48.815045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 17:18:48.815045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.814983    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 17:18:48.815202 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.815007    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 17:18:48.819843 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.819718    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 17:18:48.826018 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.825988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:48.950207 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950207 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zpm2\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-kube-api-access-2zpm2\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-web-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-out\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:48.950755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:48.950542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.050991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.050881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.050991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.050928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.050991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.050958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.050991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.050982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zpm2\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-kube-api-access-2zpm2\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-web-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-out\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.051321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.051302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054016 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.052294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054016 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.052696    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054016 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.053824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054491 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.054221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054491 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.054420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.054868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.054842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.055504 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.055443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.055644 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.055482    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.056008 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.055987    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.056227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.056208    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-config-out\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.056406 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.056384    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.056911 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.056894    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-web-config\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.059753 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.059726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zpm2\" (UniqueName: \"kubernetes.io/projected/f189b054-9a9f-4700-a2b5-4781c8d4ccf8-kube-api-access-2zpm2\") pod \"alertmanager-main-0\" (UID: \"f189b054-9a9f-4700-a2b5-4781c8d4ccf8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.122971 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.122940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 17:18:49.297125 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.297099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 17:18:49.298583 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:18:49.298553    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf189b054_9a9f_4700_a2b5_4781c8d4ccf8.slice/crio-c56792ffd06a3dec370a91118d185b81de01751d29f119de1bdf7f2003457599 WatchSource:0}: Error finding container c56792ffd06a3dec370a91118d185b81de01751d29f119de1bdf7f2003457599: Status 404 returned error can't find the container with id c56792ffd06a3dec370a91118d185b81de01751d29f119de1bdf7f2003457599
Jul 01 17:18:49.463959 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.463921    2582 generic.go:356] "Generic (PLEG): container finished" podID="f189b054-9a9f-4700-a2b5-4781c8d4ccf8" containerID="1d31fb3a12cd39d53e04c36c9e4be32ce111bba6b58c5041f217572d91b2c75b" exitCode=0
Jul 01 17:18:49.464344 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.463969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerDied","Data":"1d31fb3a12cd39d53e04c36c9e4be32ce111bba6b58c5041f217572d91b2c75b"}
Jul 01 17:18:49.464344 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:49.464035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"c56792ffd06a3dec370a91118d185b81de01751d29f119de1bdf7f2003457599"}
Jul 01 17:18:50.470822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.470775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"f0893155e493d8a844fe299f66d65aeebf9080c43c371cd34dbf17fc0a3a94fc"}
Jul 01 17:18:50.471270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.470904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"253362ea760fb067986f8e1f8ca1107bea8861f96799b7483a92f65b139e4cc7"}
Jul 01 17:18:50.471270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.470951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"f8422a3240725613362e7b3ad9057f745da54f36d3f1b6dc493e8456c513f775"}
Jul 01 17:18:50.471270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.470988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"4d9543a969af4ef432921085a6ec0be6a8dd9fa83614f630153807cc6addf2d1"}
Jul 01 17:18:50.471270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.471025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"c415e377a4e3e2cc0b673dc4dfcee07800ff560805dd54ea50587eb87de47d51"}
Jul 01 17:18:50.471270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.471060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f189b054-9a9f-4700-a2b5-4781c8d4ccf8","Type":"ContainerStarted","Data":"2aceaad90da6f1605cfbb9496fd2ba1c9c21c263428c1e4d7931f3f1620bb0f8"}
Jul 01 17:18:50.502364 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.502299    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.485567039 podStartE2EDuration="2.502276437s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.709398ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:50.499493021 +0000 UTC m=+152.273079830" watchObservedRunningTime="2026-07-01 17:18:50.502276437 +0000 UTC m=+152.275863246"
Jul 01 17:18:50.660294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:50.660255    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39308b84-12a7-4068-9edc-f43a9d408324" path="/var/lib/kubelet/pods/39308b84-12a7-4068-9edc-f43a9d408324/volumes"
Jul 01 17:18:51.211025 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.210988    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"]
Jul 01 17:18:51.214645 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.214620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.218898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.218281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 01 17:18:51.219108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.218406    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 01 17:18:51.219108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.218503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 01 17:18:51.219108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.218845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 01 17:18:51.219887 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.219672    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 01 17:18:51.219887 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.219830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qlhxf\""
Jul 01 17:18:51.224903 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.224882    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 01 17:18:51.226526 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.226497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"]
Jul 01 17:18:51.373585 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.373541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-metrics-client-ca\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.373969 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.373949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-serving-certs-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374278 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-federate-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374445 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374621 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx2b8\" (UniqueName: \"kubernetes.io/projected/6b5c21ba-7fd2-4e99-a556-7afb55428b96-kube-api-access-lx2b8\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374758 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.374758 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.374705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-metrics-client-ca\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-serving-certs-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-federate-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.475998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.475617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx2b8\" (UniqueName: \"kubernetes.io/projected/6b5c21ba-7fd2-4e99-a556-7afb55428b96-kube-api-access-lx2b8\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.476412 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.476273    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-metrics-client-ca\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.476412 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.476391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.476547 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.476475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5c21ba-7fd2-4e99-a556-7afb55428b96-serving-certs-ca-bundle\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.478186 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.478161    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.478305 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.478237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-telemeter-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.478342 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.478312    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-secret-telemeter-client\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.478634 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.478611    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5c21ba-7fd2-4e99-a556-7afb55428b96-federate-client-tls\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.484077 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.484056    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx2b8\" (UniqueName: \"kubernetes.io/projected/6b5c21ba-7fd2-4e99-a556-7afb55428b96-kube-api-access-lx2b8\") pod \"telemeter-client-6bdc5f5664-z75sb\" (UID: \"6b5c21ba-7fd2-4e99-a556-7afb55428b96\") " pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.527467 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.527166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"
Jul 01 17:18:51.548909 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.548865    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.549547    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0" gracePeriod=600
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.550208    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-web" containerID="cri-o://a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6" gracePeriod=600
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.550353    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy" containerID="cri-o://5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f" gracePeriod=600
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.550467    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="thanos-sidecar" containerID="cri-o://10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c" gracePeriod=600
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.550563    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="config-reloader" containerID="cri-o://96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d" gracePeriod=600
Jul 01 17:18:51.550854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.550564    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="prometheus" containerID="cri-o://a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647" gracePeriod=600
Jul 01 17:18:51.716099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.716075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bdc5f5664-z75sb"]
Jul 01 17:18:51.718940 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:18:51.718912    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5c21ba_7fd2_4e99_a556_7afb55428b96.slice/crio-2558499cf33bac6f7a0c68ec457c9e4843fdbb59018d54f5110839061b11dbb3 WatchSource:0}: Error finding container 2558499cf33bac6f7a0c68ec457c9e4843fdbb59018d54f5110839061b11dbb3: Status 404 returned error can't find the container with id 2558499cf33bac6f7a0c68ec457c9e4843fdbb59018d54f5110839061b11dbb3
Jul 01 17:18:51.816788 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.816752    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:51.982599 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982562    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.982599 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982604    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.982855 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.982855 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.982855 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982842    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983010 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983010 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982912    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983010 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983010 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.982982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983011    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983043    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983080    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67tqx\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983084    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983104    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983168    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983204    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983732 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983234    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983732 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983271    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983732 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983321    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983732 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983329    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.983732 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy\") pod \"905591ef-87f5-4ecf-a883-33c6dd4c174e\" (UID: \"905591ef-87f5-4ecf-a883-33c6dd4c174e\") "
Jul 01 17:18:51.983957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983844    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:51.983957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983869    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-metrics-client-ca\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:51.983957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983885    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:51.983957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983838    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.984147 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.983984    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:18:51.984986 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.984236    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.984986 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.984500    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.986053 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.986022    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.986191 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.986164    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:18:51.986400 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.986376    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config" (OuterVolumeSpecName: "config") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.986496 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.986393    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:18:51.987075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.987002    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.987350 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.987306    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.988033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988004    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.988317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988241    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.988317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988254    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out" (OuterVolumeSpecName: "config-out") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:18:51.988426 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988352    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx" (OuterVolumeSpecName: "kube-api-access-67tqx") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "kube-api-access-67tqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:18:51.988801 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988773    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.989003 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.988987    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:51.997687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:51.997664    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config" (OuterVolumeSpecName: "web-config") pod "905591ef-87f5-4ecf-a883-33c6dd4c174e" (UID: "905591ef-87f5-4ecf-a883-33c6dd4c174e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:18:52.085385 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085323    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-web-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085385 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085384    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67tqx\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-kube-api-access-67tqx\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085402    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085418    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085433    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085480    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085495    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-config-out\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085508    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085516    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-grpc-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085524    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-kube-rbac-proxy\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085532    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085541    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/905591ef-87f5-4ecf-a883-33c6dd4c174e-tls-assets\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085553    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085561    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-metrics-client-certs\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085569    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/905591ef-87f5-4ecf-a883-33c6dd4c174e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085579    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-db\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.085628 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.085588    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/905591ef-87f5-4ecf-a883-33c6dd4c174e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:18:52.482287 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.482237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb" event={"ID":"6b5c21ba-7fd2-4e99-a556-7afb55428b96","Type":"ContainerStarted","Data":"2558499cf33bac6f7a0c68ec457c9e4843fdbb59018d54f5110839061b11dbb3"}
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486609    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0" exitCode=0
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486636    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f" exitCode=0
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486647    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6" exitCode=0
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486656    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c" exitCode=0
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486665    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d" exitCode=0
Jul 01 17:18:52.486682 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486674    2582 generic.go:356] "Generic (PLEG): container finished" podID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647" exitCode=0
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"}
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"}
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486703    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"}
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"}
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"}
Jul 01 17:18:52.486933 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"}
Jul 01 17:18:52.487253 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.486969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"905591ef-87f5-4ecf-a883-33c6dd4c174e","Type":"ContainerDied","Data":"40c007b686d539a89ee58afae81715b76f0ac27144dc3032ffe177d33e714dcc"}
Jul 01 17:18:52.487253 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.487014    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.507388 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.507364    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.515867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.515846    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.525069 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.525037    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:52.525337 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.525316    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.531545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.531521    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:52.533248 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.533101    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.540176 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.540160    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.547658 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.547639    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.554724 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.554707    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.555016 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.554999    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.555076 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555031    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.555076 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555052    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.555276 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.555261    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.555317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555280    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.555317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555292    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.555551 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.555529    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.555610 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555558    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.555610 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555576    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.555825 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.555810    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.555876 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555829    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.555876 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.555851    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.556037 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.556023    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.556072 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556041    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.556072 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556054    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.556280 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.556264    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.556325 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556283    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.556325 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556295    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.556528 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:18:52.556512    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.556592 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556531    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.556592 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556543    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.556804 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556762    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.556804 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.556789    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.557091 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557068    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.557091 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557089    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.557552 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557417    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.557552 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557444    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.557745 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557719    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.557807 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.557746    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.558080 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558055    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.558145 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558083    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.558347 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558326    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.558425 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558350    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.558632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558598    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.558632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558632    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.558890 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558868    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.558890 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.558889    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.559214 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559189    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.559289 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559215    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.559444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559426    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.559536 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559444    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.559703 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559685    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.559779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559703    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.559939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559913    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.559997 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.559942    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.560227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560207    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.560227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560228    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.560471 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560431    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.560471 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560466    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.560752 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560724    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.560839 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.560755    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.561776 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.561753    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.561873 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.561778    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.562228 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562180    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.562341 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562229    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.562614 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562589    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.562614 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562615    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.562874 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562846    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.562945 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.562876    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.563151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.563119    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.563151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.563147    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.563427 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.563395    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.563427 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.563424    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.564295 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.564189    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.564295 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.564216    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.564605 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.564587    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.564993    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="init-config-reloader"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565012    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="init-config-reloader"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565023    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="config-reloader"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565032    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="config-reloader"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565047    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565056    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565084    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-web"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565092    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-web"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565107    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="prometheus"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565115    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="prometheus"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565124    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-thanos"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565131    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-thanos"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565141    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="thanos-sidecar"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565148    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="thanos-sidecar"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565233    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="prometheus"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565243    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-thanos"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565254    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="config-reloader"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565262    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="thanos-sidecar"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565272    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy-web"
Jul 01 17:18:52.566637 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.565281    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" containerName="kube-rbac-proxy"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.566899    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.566922    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.567141    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.567162    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.567419    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.567673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.567442    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.568105 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568084    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.568173 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568107    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.568368 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568342    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.568491 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568370    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.568670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568646    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.568743 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568671    2582 scope.go:117] "RemoveContainer" containerID="2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"
Jul 01 17:18:52.568976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568946    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0"} err="failed to get container status \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": rpc error: code = NotFound desc = could not find container \"2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0\": container with ID starting with 2e27b23dcc2e1748a5852f9b6011e9e2ca498d6f2d58ee256dbb51be9afaaab0 not found: ID does not exist"
Jul 01 17:18:52.569063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.568977    2582 scope.go:117] "RemoveContainer" containerID="5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"
Jul 01 17:18:52.569283 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569258    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f"} err="failed to get container status \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": rpc error: code = NotFound desc = could not find container \"5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f\": container with ID starting with 5de21803248340c886a08cad3292568f21dedeaeb881fe28acc14650d706501f not found: ID does not exist"
Jul 01 17:18:52.569372 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569284    2582 scope.go:117] "RemoveContainer" containerID="a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"
Jul 01 17:18:52.569627 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6"} err="failed to get container status \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": rpc error: code = NotFound desc = could not find container \"a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6\": container with ID starting with a355e2c18a4484c65a21bfd484181995c8390fbd0ee908b5daae65277d7290e6 not found: ID does not exist"
Jul 01 17:18:52.569627 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569623    2582 scope.go:117] "RemoveContainer" containerID="10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"
Jul 01 17:18:52.569805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.569873 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569842    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c"} err="failed to get container status \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": rpc error: code = NotFound desc = could not find container \"10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c\": container with ID starting with 10759ae28dcc025811ee37fce3df9a3e1e8be9477bced31b0c05d89b1829d04c not found: ID does not exist"
Jul 01 17:18:52.569873 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.569866    2582 scope.go:117] "RemoveContainer" containerID="96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"
Jul 01 17:18:52.570216 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.570185    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d"} err="failed to get container status \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": rpc error: code = NotFound desc = could not find container \"96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d\": container with ID starting with 96eae030cdb6cb0dc23543caeb67ef5a8c3d0ec50b2e5c8d64e14a5c93601c1d not found: ID does not exist"
Jul 01 17:18:52.570337 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.570217    2582 scope.go:117] "RemoveContainer" containerID="a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"
Jul 01 17:18:52.570672 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.570642    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647"} err="failed to get container status \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": rpc error: code = NotFound desc = could not find container \"a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647\": container with ID starting with a0f6828b68393d650168b06a36b7f8a51b7a034354b0683ee9b2cd9682f76647 not found: ID does not exist"
Jul 01 17:18:52.570772 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.570675    2582 scope.go:117] "RemoveContainer" containerID="f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"
Jul 01 17:18:52.571402 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.571375    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7"} err="failed to get container status \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": rpc error: code = NotFound desc = could not find container \"f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7\": container with ID starting with f3a528fc301e8f902061f6acaddbf2f0edb9f323083a63a7d8aad797bae30de7 not found: ID does not exist"
Jul 01 17:18:52.572840 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.572819    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 01 17:18:52.572936 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.572884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 01 17:18:52.573006 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.572987    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 01 17:18:52.573041 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573030    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5659l1h7o91hs\""
Jul 01 17:18:52.573088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 01 17:18:52.573139 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 01 17:18:52.573196 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xgrbm\""
Jul 01 17:18:52.573421 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 01 17:18:52.573519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 01 17:18:52.573577 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 01 17:18:52.573632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 01 17:18:52.573707 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 01 17:18:52.573844 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.573761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 01 17:18:52.574133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.574114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 01 17:18:52.575886 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.575863    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 01 17:18:52.580017 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.579801    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 01 17:18:52.583377 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.583356    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:52.660616 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.660578    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="905591ef-87f5-4ecf-a883-33c6dd4c174e" path="/var/lib/kubelet/pods/905591ef-87f5-4ecf-a883-33c6dd4c174e/volumes"
Jul 01 17:18:52.690366 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690366 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690636 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690670    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-web-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-config-out\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99hn\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-kube-api-access-m99hn\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.690857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.691133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.691133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.691133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.690911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792235 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-web-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-config-out\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99hn\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-kube-api-access-m99hn\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.792695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.793027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.792964    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.794112 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.793635    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.794112 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.793672    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.794112 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.793817    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.795173 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.794751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.796848 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.796540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.796848 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.796577    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.797011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.796978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.797663    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.798151    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.798322    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799177    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799177    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.799429 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799326    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.800032 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799490    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-web-config\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.800032 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799514    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66d48a23-6db2-4363-9194-3a562478edbb-config-out\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.800032 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.799835    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.800370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.800347    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66d48a23-6db2-4363-9194-3a562478edbb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.802276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.802193    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66d48a23-6db2-4363-9194-3a562478edbb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.807798 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.807773    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99hn\" (UniqueName: \"kubernetes.io/projected/66d48a23-6db2-4363-9194-3a562478edbb-kube-api-access-m99hn\") pod \"prometheus-k8s-0\" (UID: \"66d48a23-6db2-4363-9194-3a562478edbb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:52.883918 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:52.883867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:18:53.047878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:53.047788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 17:18:53.051914 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:18:53.051876    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d48a23_6db2_4363_9194_3a562478edbb.slice/crio-319a07fd96d341adea1c2a2be8f9bf8699abdb1e78a6104e8243228f8875f6f4 WatchSource:0}: Error finding container 319a07fd96d341adea1c2a2be8f9bf8699abdb1e78a6104e8243228f8875f6f4: Status 404 returned error can't find the container with id 319a07fd96d341adea1c2a2be8f9bf8699abdb1e78a6104e8243228f8875f6f4
Jul 01 17:18:53.493785 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:53.493684    2582 generic.go:356] "Generic (PLEG): container finished" podID="66d48a23-6db2-4363-9194-3a562478edbb" containerID="83f26e5f91ae8ec8c000e4afb286646a724d4741cd38caa68c14a5ce12e079d7" exitCode=0
Jul 01 17:18:53.493785 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:53.493773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerDied","Data":"83f26e5f91ae8ec8c000e4afb286646a724d4741cd38caa68c14a5ce12e079d7"}
Jul 01 17:18:53.494298 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:53.493904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"319a07fd96d341adea1c2a2be8f9bf8699abdb1e78a6104e8243228f8875f6f4"}
Jul 01 17:18:54.503482 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"e921da95ffae6b2eba18e225b93f414a6dfe701b49b3f1bbc9f9d097196a854f"}
Jul 01 17:18:54.503938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"81cce1e432f00760998c4ba40593a2d96c25782f95f97258f3239be2c213bcd6"}
Jul 01 17:18:54.503938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"3532c3c86bb53f1ed95384d429bec054cdec0df0639de6cad691ef06b678f805"}
Jul 01 17:18:54.503938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"f8b6b6f8737875883d71b226432f591065bf79fb613070aca756da219e87f012"}
Jul 01 17:18:54.503938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"934b56fa6dee3663bf863f1d71a1b2ac9ecb16af4856ca06eac4343d35dd206c"}
Jul 01 17:18:54.503938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.503706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66d48a23-6db2-4363-9194-3a562478edbb","Type":"ContainerStarted","Data":"b545a321621b8bebea33b13e388a5b1ef95615ddc4553de698313a5d45e672cc"}
Jul 01 17:18:54.505673 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.505644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb" event={"ID":"6b5c21ba-7fd2-4e99-a556-7afb55428b96","Type":"ContainerStarted","Data":"27e043c9b8814134eee65cbe9735bf429484d5c204d954dc79fbcdc3e027ea06"}
Jul 01 17:18:54.505793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.505703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb" event={"ID":"6b5c21ba-7fd2-4e99-a556-7afb55428b96","Type":"ContainerStarted","Data":"a87827c05e7adac35e7ecf8d9acfcdc0421821034d56a3d40c3546d3fa7cf326"}
Jul 01 17:18:54.505793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.505731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb" event={"ID":"6b5c21ba-7fd2-4e99-a556-7afb55428b96","Type":"ContainerStarted","Data":"7a9850ab1ec1dd013f547c256768c9b0347327c76cc3bacd3e981a21bc36c741"}
Jul 01 17:18:54.536365 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.536300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.515376584 podStartE2EDuration="2.536275822s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.899238ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:54.534389374 +0000 UTC m=+156.307976179" watchObservedRunningTime="2026-07-01 17:18:54.536275822 +0000 UTC m=+156.309862629"
Jul 01 17:18:54.555622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:54.555566    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bdc5f5664-z75sb" podStartSLOduration=1.562096953 podStartE2EDuration="3.555547558s" totalImagesPullingTime="1.993450605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:54.554310198 +0000 UTC m=+156.327897005" watchObservedRunningTime="2026-07-01 17:18:54.555547558 +0000 UTC m=+156.329134362"
Jul 01 17:18:57.884990 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:18:57.884930    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:19:52.884123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:19:52.884076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:19:52.900946 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:19:52.900921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:19:53.772603 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:19:53.772575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 17:21:18.608183 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:21:18.608146    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:21:18.613346 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:21:18.613318    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:21:18.615099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:21:18.615076    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 17:24:26.104810 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.104774    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-z8xtt"]
Jul 01 17:24:26.107437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.107419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.111287 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.111265    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 17:24:26.111433 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.111358    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zr8sb\""
Jul 01 17:24:26.112497 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.112477    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 17:24:26.112604 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.112483    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 17:24:26.117979 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.117958    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-z8xtt"]
Jul 01 17:24:26.164418 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.164384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72r4\" (UniqueName: \"kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.164621 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.164437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.264925 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.264892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72r4\" (UniqueName: \"kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.265045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.264937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.265260 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.265246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.278519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.278478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72r4\" (UniqueName: \"kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4\") pod \"s3-init-z8xtt\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") " pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.430864 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.430767    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-z8xtt"
Jul 01 17:24:26.573698 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.573658    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-z8xtt"]
Jul 01 17:24:26.577684 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:24:26.577651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33e8c360_d4ae_47ca_b372_e2056ea1e539.slice/crio-9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5 WatchSource:0}: Error finding container 9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5: Status 404 returned error can't find the container with id 9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5
Jul 01 17:24:26.579742 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.579722    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:24:26.878106 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:26.878070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerStarted","Data":"9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5"}
Jul 01 17:24:30.907889 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:30.907847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerStarted","Data":"0a808e0672670681f383916f8e95b188852b66a4e057a80aa5e891edd6fd9083"}
Jul 01 17:24:32.925719 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:32.925682    2582 generic.go:356] "Generic (PLEG): container finished" podID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerID="0a808e0672670681f383916f8e95b188852b66a4e057a80aa5e891edd6fd9083" exitCode=0
Jul 01 17:24:32.926123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:32.925739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerDied","Data":"0a808e0672670681f383916f8e95b188852b66a4e057a80aa5e891edd6fd9083"}
Jul 01 17:24:38.957877 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:38.957838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerStarted","Data":"7f22c76a373c3100727e164333c6131b39dc45d8058a967b2ffb76a73ab8d881"}
Jul 01 17:24:38.976600 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:24:38.976546    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-z8xtt" podStartSLOduration=2.096252958 podStartE2EDuration="12.976530243s" totalImagesPullingTime="9.220207836s" totalInitContainerRuntime="1.660069449s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:24:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:38.975652778 +0000 UTC m=+500.749239582" watchObservedRunningTime="2026-07-01 17:24:38.976530243 +0000 UTC m=+500.750117118"
Jul 01 17:25:43.221042 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:43.221009    2582 generic.go:356] "Generic (PLEG): container finished" podID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerID="7f22c76a373c3100727e164333c6131b39dc45d8058a967b2ffb76a73ab8d881" exitCode=0
Jul 01 17:25:43.221484 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:43.221055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerDied","Data":"7f22c76a373c3100727e164333c6131b39dc45d8058a967b2ffb76a73ab8d881"}
Jul 01 17:25:44.349727 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.349702    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-z8xtt"
Jul 01 17:25:44.379701 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.379668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache\") pod \"33e8c360-d4ae-47ca-b372-e2056ea1e539\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") "
Jul 01 17:25:44.379892 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.379747    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j72r4\" (UniqueName: \"kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4\") pod \"33e8c360-d4ae-47ca-b372-e2056ea1e539\" (UID: \"33e8c360-d4ae-47ca-b372-e2056ea1e539\") "
Jul 01 17:25:44.382126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.382099    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4" (OuterVolumeSpecName: "kube-api-access-j72r4") pod "33e8c360-d4ae-47ca-b372-e2056ea1e539" (UID: "33e8c360-d4ae-47ca-b372-e2056ea1e539"). InnerVolumeSpecName "kube-api-access-j72r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:25:44.398042 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.398008    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache" (OuterVolumeSpecName: "model-cache") pod "33e8c360-d4ae-47ca-b372-e2056ea1e539" (UID: "33e8c360-d4ae-47ca-b372-e2056ea1e539"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:25:44.480794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.480705    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e8c360-d4ae-47ca-b372-e2056ea1e539-model-cache\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:25:44.480794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:44.480736    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j72r4\" (UniqueName: \"kubernetes.io/projected/33e8c360-d4ae-47ca-b372-e2056ea1e539-kube-api-access-j72r4\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:25:45.230755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:45.230713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-z8xtt" event={"ID":"33e8c360-d4ae-47ca-b372-e2056ea1e539","Type":"ContainerDied","Data":"9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5"}
Jul 01 17:25:45.230755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:45.230751    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-z8xtt"
Jul 01 17:25:45.230755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:45.230756    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fa703638991a30a658c5ef83f3762efa392d509547b76f94ffb931851a0dcc5"
Jul 01 17:25:56.853614 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-lkmrg"]
Jul 01 17:25:56.854011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853899    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerName="s3-init"
Jul 01 17:25:56.854011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853910    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerName="s3-init"
Jul 01 17:25:56.854011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853930    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerName="download-hf-model"
Jul 01 17:25:56.854011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853935    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerName="download-hf-model"
Jul 01 17:25:56.854011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.853989    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e8c360-d4ae-47ca-b372-e2056ea1e539" containerName="s3-init"
Jul 01 17:25:56.856888 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.856870    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.859689 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.859665    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 17:25:56.859689 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.859676    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 17:25:56.859857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.859740    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zr8sb\""
Jul 01 17:25:56.860690 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.860658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 01 17:25:56.865770 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.865747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-lkmrg"]
Jul 01 17:25:56.881581 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.881549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwm4v\" (UniqueName: \"kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.881741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.881602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.982887 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.982791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwm4v\" (UniqueName: \"kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.982887 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.982849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.983216 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.983199    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:56.991398 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:56.991365    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwm4v\" (UniqueName: \"kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v\") pod \"s3-tls-init-custom-lkmrg\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") " pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:57.179205 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:57.179170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:25:57.311679 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:57.311654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-lkmrg"]
Jul 01 17:25:57.314089 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:25:57.314056    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod700fa123_e0ff_4d1e_962b_1934c0929a12.slice/crio-3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5 WatchSource:0}: Error finding container 3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5: Status 404 returned error can't find the container with id 3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5
Jul 01 17:25:58.295629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:58.295582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerStarted","Data":"be62019c822a4c0c21251a14755553a16ef9d80874f6e633b6cf22b7ed0d10a8"}
Jul 01 17:25:58.295629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:58.295633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerStarted","Data":"3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5"}
Jul 01 17:25:59.301446 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:59.301413    2582 generic.go:356] "Generic (PLEG): container finished" podID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerID="be62019c822a4c0c21251a14755553a16ef9d80874f6e633b6cf22b7ed0d10a8" exitCode=0
Jul 01 17:25:59.301783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:25:59.301499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerDied","Data":"be62019c822a4c0c21251a14755553a16ef9d80874f6e633b6cf22b7ed0d10a8"}
Jul 01 17:26:00.307508 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:00.307473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerStarted","Data":"77aa77f4d261444acfca7d089d5e280d7f78722de24e6eb18494e83915a1cca8"}
Jul 01 17:26:00.324769 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:00.324716    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-lkmrg" podStartSLOduration=2.431488148 podStartE2EDuration="4.324701062s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.893212914s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:26:00.323980093 +0000 UTC m=+582.097566897" watchObservedRunningTime="2026-07-01 17:26:00.324701062 +0000 UTC m=+582.098287866"
Jul 01 17:26:06.338840 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:06.338804    2582 generic.go:356] "Generic (PLEG): container finished" podID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerID="77aa77f4d261444acfca7d089d5e280d7f78722de24e6eb18494e83915a1cca8" exitCode=0
Jul 01 17:26:06.339218 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:06.338875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerDied","Data":"77aa77f4d261444acfca7d089d5e280d7f78722de24e6eb18494e83915a1cca8"}
Jul 01 17:26:07.489497 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.489472    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:26:07.584178 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.584145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwm4v\" (UniqueName: \"kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v\") pod \"700fa123-e0ff-4d1e-962b-1934c0929a12\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") "
Jul 01 17:26:07.584178 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.584187    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache\") pod \"700fa123-e0ff-4d1e-962b-1934c0929a12\" (UID: \"700fa123-e0ff-4d1e-962b-1934c0929a12\") "
Jul 01 17:26:07.586503 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.586479    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v" (OuterVolumeSpecName: "kube-api-access-kwm4v") pod "700fa123-e0ff-4d1e-962b-1934c0929a12" (UID: "700fa123-e0ff-4d1e-962b-1934c0929a12"). InnerVolumeSpecName "kube-api-access-kwm4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:26:07.607265 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.607203    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache" (OuterVolumeSpecName: "model-cache") pod "700fa123-e0ff-4d1e-962b-1934c0929a12" (UID: "700fa123-e0ff-4d1e-962b-1934c0929a12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:26:07.685805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.685768    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwm4v\" (UniqueName: \"kubernetes.io/projected/700fa123-e0ff-4d1e-962b-1934c0929a12-kube-api-access-kwm4v\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:26:07.685805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:07.685800    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/700fa123-e0ff-4d1e-962b-1934c0929a12-model-cache\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:26:08.349555 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:08.349526    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-lkmrg"
Jul 01 17:26:08.349555 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:08.349540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-lkmrg" event={"ID":"700fa123-e0ff-4d1e-962b-1934c0929a12","Type":"ContainerDied","Data":"3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5"}
Jul 01 17:26:08.349775 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:08.349579    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cd090b8951dda15bd4cdb47a539905e4d490eadf0fdc07f0c6aae7631fe84a5"
Jul 01 17:26:09.083572 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.083531    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"]
Jul 01 17:26:09.084046 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.084033    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerName="download-hf-model"
Jul 01 17:26:09.084113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.084054    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerName="download-hf-model"
Jul 01 17:26:09.084113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.084083    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerName="s3-tls-init-custom"
Jul 01 17:26:09.084113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.084092    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerName="s3-tls-init-custom"
Jul 01 17:26:09.084253 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.084185    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="700fa123-e0ff-4d1e-962b-1934c0929a12" containerName="s3-tls-init-custom"
Jul 01 17:26:09.089013 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.088987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.091783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.091761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Jul 01 17:26:09.093007 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.092985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\""
Jul 01 17:26:09.093126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.093007    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 17:26:09.093126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.092987    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zr8sb\""
Jul 01 17:26:09.093126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.092990    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 17:26:09.098568 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.098542    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"]
Jul 01 17:26:09.199131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.199092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwnmp\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-kube-api-access-nwnmp\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.199393 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.199157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.199393 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.199278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fad3abdd-b8a1-4618-836e-dae54546d5e4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.299818 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.299777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fad3abdd-b8a1-4618-836e-dae54546d5e4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.299977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.299827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwnmp\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-kube-api-access-nwnmp\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.299977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.299854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.300085 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:26:09.299982    2582 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found
Jul 01 17:26:09.300085 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:26:09.299994    2582 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz: secret "seaweedfs-tls-serving" not found
Jul 01 17:26:09.300085 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:26:09.300052    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving podName:fad3abdd-b8a1-4618-836e-dae54546d5e4 nodeName:}" failed. No retries permitted until 2026-07-01 17:26:09.800033294 +0000 UTC m=+591.573620090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-ff5jz" (UID: "fad3abdd-b8a1-4618-836e-dae54546d5e4") : secret "seaweedfs-tls-serving" not found
Jul 01 17:26:09.300219 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.300151    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fad3abdd-b8a1-4618-836e-dae54546d5e4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.310541 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.310512    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwnmp\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-kube-api-access-nwnmp\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.803226 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.803178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.805802 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.805777    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fad3abdd-b8a1-4618-836e-dae54546d5e4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-ff5jz\" (UID: \"fad3abdd-b8a1-4618-836e-dae54546d5e4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:09.999917 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:09.999859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"
Jul 01 17:26:10.135829 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:10.135698    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz"]
Jul 01 17:26:10.138224 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:26:10.138183    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad3abdd_b8a1_4618_836e_dae54546d5e4.slice/crio-17208b05695eba407ac839dda442870c8545f2d78410be153c66f1456ab3484c WatchSource:0}: Error finding container 17208b05695eba407ac839dda442870c8545f2d78410be153c66f1456ab3484c: Status 404 returned error can't find the container with id 17208b05695eba407ac839dda442870c8545f2d78410be153c66f1456ab3484c
Jul 01 17:26:10.360145 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:10.360008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz" event={"ID":"fad3abdd-b8a1-4618-836e-dae54546d5e4","Type":"ContainerStarted","Data":"17208b05695eba407ac839dda442870c8545f2d78410be153c66f1456ab3484c"}
Jul 01 17:26:13.379954 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:13.379920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz" event={"ID":"fad3abdd-b8a1-4618-836e-dae54546d5e4","Type":"ContainerStarted","Data":"321327a13b16a42614e156fba7646d53f9f41492f471c1f8b04f96403f7027f8"}
Jul 01 17:26:13.400473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:13.398235    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-ff5jz" podStartSLOduration=1.599643557 podStartE2EDuration="4.398212088s" totalImagesPullingTime="2.798568531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:26:13.395058282 +0000 UTC m=+595.168645087" watchObservedRunningTime="2026-07-01 17:26:13.398212088 +0000 UTC m=+595.171798894"
Jul 01 17:26:14.047155 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.047122    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-n2sf2"]
Jul 01 17:26:14.051873 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.051852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.058507 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.058480    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-n2sf2"]
Jul 01 17:26:14.142839 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.142804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.143098 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.142847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vs8\" (UniqueName: \"kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.244390 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.244352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.244390 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.244393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vs8\" (UniqueName: \"kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.244783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.244761    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.253551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.253517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vs8\" (UniqueName: \"kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8\") pod \"s3-tls-init-serving-n2sf2\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") " pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.374866 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.374762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:14.514905 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:14.514871    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-n2sf2"]
Jul 01 17:26:14.518638 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:26:14.518600    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddde9bc90_3f35_4bcd_ba87_d11832de1464.slice/crio-89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb WatchSource:0}: Error finding container 89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb: Status 404 returned error can't find the container with id 89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb
Jul 01 17:26:15.392968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:15.392925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerStarted","Data":"3184814b9e5654c68f9a571ef4c4c4b69cad46e0267dc34888a1e02ce4bd935c"}
Jul 01 17:26:15.393133 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:15.392977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerStarted","Data":"89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb"}
Jul 01 17:26:16.398958 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:16.398927    2582 generic.go:356] "Generic (PLEG): container finished" podID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerID="3184814b9e5654c68f9a571ef4c4c4b69cad46e0267dc34888a1e02ce4bd935c" exitCode=0
Jul 01 17:26:16.399342 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:16.398994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerDied","Data":"3184814b9e5654c68f9a571ef4c4c4b69cad46e0267dc34888a1e02ce4bd935c"}
Jul 01 17:26:17.405744 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:17.405709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerStarted","Data":"996f24b3da3b981656f147e9cdd53195976ce29fe9f4d244db981bfeeac84275"}
Jul 01 17:26:17.423703 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:17.423651    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-n2sf2" podStartSLOduration=1.790574509 podStartE2EDuration="3.423636231s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.633061722s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:26:17.422379062 +0000 UTC m=+599.195965865" watchObservedRunningTime="2026-07-01 17:26:17.423636231 +0000 UTC m=+599.197223035"
Jul 01 17:26:18.639654 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:18.639626    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:26:18.640802 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:18.640778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:26:23.435401 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:23.435364    2582 generic.go:356] "Generic (PLEG): container finished" podID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerID="996f24b3da3b981656f147e9cdd53195976ce29fe9f4d244db981bfeeac84275" exitCode=0
Jul 01 17:26:23.435909 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:23.435441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerDied","Data":"996f24b3da3b981656f147e9cdd53195976ce29fe9f4d244db981bfeeac84275"}
Jul 01 17:26:24.599507 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.599474    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:24.745213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.745101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache\") pod \"dde9bc90-3f35-4bcd-ba87-d11832de1464\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") "
Jul 01 17:26:24.745213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.745163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vs8\" (UniqueName: \"kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8\") pod \"dde9bc90-3f35-4bcd-ba87-d11832de1464\" (UID: \"dde9bc90-3f35-4bcd-ba87-d11832de1464\") "
Jul 01 17:26:24.747390 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.747358    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8" (OuterVolumeSpecName: "kube-api-access-49vs8") pod "dde9bc90-3f35-4bcd-ba87-d11832de1464" (UID: "dde9bc90-3f35-4bcd-ba87-d11832de1464"). InnerVolumeSpecName "kube-api-access-49vs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:26:24.767705 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.767676    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache" (OuterVolumeSpecName: "model-cache") pod "dde9bc90-3f35-4bcd-ba87-d11832de1464" (UID: "dde9bc90-3f35-4bcd-ba87-d11832de1464"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:26:24.846671 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.846632    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dde9bc90-3f35-4bcd-ba87-d11832de1464-model-cache\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:26:24.846671 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:24.846662    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vs8\" (UniqueName: \"kubernetes.io/projected/dde9bc90-3f35-4bcd-ba87-d11832de1464-kube-api-access-49vs8\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:26:25.446883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:25.446859    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-n2sf2"
Jul 01 17:26:25.447061 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:25.446902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-n2sf2" event={"ID":"dde9bc90-3f35-4bcd-ba87-d11832de1464","Type":"ContainerDied","Data":"89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb"}
Jul 01 17:26:25.447061 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:25.446938    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89627661e7b7528b8767ff0e00de78f5835ce0a051fdd1713c53e37ed8196abb"
Jul 01 17:26:39.062125 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:26:39.062549 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062477    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerName="download-hf-model"
Jul 01 17:26:39.062549 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062493    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerName="download-hf-model"
Jul 01 17:26:39.062549 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062503    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerName="s3-tls-init-serving"
Jul 01 17:26:39.062549 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062516    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerName="s3-tls-init-serving"
Jul 01 17:26:39.062727 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.062588    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde9bc90-3f35-4bcd-ba87-d11832de1464" containerName="s3-tls-init-serving"
Jul 01 17:26:39.066177 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.066150    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069214    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-kube-rbac-proxy-sar-config\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069522    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069715    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-predictor-serving-cert\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069772    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.069811    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:26:39.070481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.070432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l8gxp\""
Jul 01 17:26:39.075844 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.075812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.076020 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.075929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k69zm\" (UniqueName: \"kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.076020 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.075992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.076131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.076023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.076131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.076098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.077300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.077274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:26:39.177550 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.177493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.177550 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.177555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.177776 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.177587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.177776 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.177644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.177776 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.177714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k69zm\" (UniqueName: \"kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.177910 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:26:39.177842    2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-serving-cert: secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 01 17:26:39.177966 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:26:39.177952    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls podName:36b072f6-c177-41c4-a47d-63563e921665 nodeName:}" failed. No retries permitted until 2026-07-01 17:26:39.677926302 +0000 UTC m=+621.451513086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls") pod "isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" (UID: "36b072f6-c177-41c4-a47d-63563e921665") : secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 01 17:26:39.178102 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.178082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.178338 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.178320    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.178388 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.178321    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.186689 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.186657    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k69zm\" (UniqueName: \"kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.681712 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.681668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.684541 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.684516    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:39.983701 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:39.983604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:26:40.129114 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:40.129082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:26:40.130987 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:26:40.130960    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b072f6_c177_41c4_a47d_63563e921665.slice/crio-15ff92f3536b0c6a2c0f710f9b868fa4a84d96f2ed488cf0198d245c084443d5 WatchSource:0}: Error finding container 15ff92f3536b0c6a2c0f710f9b868fa4a84d96f2ed488cf0198d245c084443d5: Status 404 returned error can't find the container with id 15ff92f3536b0c6a2c0f710f9b868fa4a84d96f2ed488cf0198d245c084443d5
Jul 01 17:26:40.513348 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:40.513315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerStarted","Data":"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"}
Jul 01 17:26:40.513577 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:40.513393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerStarted","Data":"15ff92f3536b0c6a2c0f710f9b868fa4a84d96f2ed488cf0198d245c084443d5"}
Jul 01 17:26:44.531964 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:44.531930    2582 generic.go:356] "Generic (PLEG): container finished" podID="36b072f6-c177-41c4-a47d-63563e921665" containerID="1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82" exitCode=0
Jul 01 17:26:44.532370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:26:44.532012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerDied","Data":"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"}
Jul 01 17:27:00.626916 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:00.626855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerStarted","Data":"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"}
Jul 01 17:27:03.647913 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:03.647866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerStarted","Data":"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"}
Jul 01 17:27:06.664365 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:06.664324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerStarted","Data":"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"}
Jul 01 17:27:06.664918 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:06.664607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:27:06.664918 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:06.664729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:27:06.665886 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:06.665852    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:06.687129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:06.687079    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podStartSLOduration=2.836796097 podStartE2EDuration="27.687063259s" totalImagesPullingTime="21.042315735s" totalInitContainerRuntime="3.807951427s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:26:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:27:06.685527241 +0000 UTC m=+648.459114047" watchObservedRunningTime="2026-07-01 17:27:06.687063259 +0000 UTC m=+648.460650063"
Jul 01 17:27:07.669022 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:07.668979    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:27:07.669497 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:07.669137    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:07.670056 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:07.670030    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:07.673041 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:07.673025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:27:08.674040 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:08.674002    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:08.674442 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:08.674268    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:09.679953 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:09.679908    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:09.680435 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:09.680282    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:19.680259 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:19.680206    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:19.680745 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:19.680725    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:29.680545 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:29.680500    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:29.681111 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:29.681082    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:39.679826 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:39.679782    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:39.680387 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:39.680163    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:49.680754 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:49.680696    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:49.681272 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:49.681179    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:27:59.680104 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:59.680047    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:27:59.680595 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:27:59.680552    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:09.680647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:09.680550    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:28:09.681190 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:09.681021    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:19.680544 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:19.680505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:28:19.681129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:19.680645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:28:34.419052 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.419019    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:28:34.419481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.419292    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" containerID="cri-o://857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f" gracePeriod=30
Jul 01 17:28:34.419481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.419336    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" containerID="cri-o://903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8" gracePeriod=30
Jul 01 17:28:34.419481 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.419372    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" containerID="cri-o://497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f" gracePeriod=30
Jul 01 17:28:34.440870 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.440840    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:28:34.443891 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.443871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.446645 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.446612    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-predictor-serving-cert\""
Jul 01 17:28:34.446760 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.446684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-kube-rbac-proxy-sar-config\""
Jul 01 17:28:34.461022 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.460990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:28:34.547666 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.547637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6p4l\" (UniqueName: \"kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.547829 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.547701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.547829 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.547761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.547905 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.547827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.547905 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.547872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.648805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.648763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6p4l\" (UniqueName: \"kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.648826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.648882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.649011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649175 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.649058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649508 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.649485    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649576 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.649552    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.649665 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.649649    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.651749 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.651729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.658238 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.658214    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6p4l\" (UniqueName: \"kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l\") pod \"isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.754805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.754711    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:34.900218 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:34.900189    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:28:34.902185 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:28:34.902144    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb253f24d_ef2d_4016_be94_085ad9f89ddc.slice/crio-ae5f9f5364875ac6bb724e5032a2aa1ffda41306f8435ab4aec41d24fd3a7fa9 WatchSource:0}: Error finding container ae5f9f5364875ac6bb724e5032a2aa1ffda41306f8435ab4aec41d24fd3a7fa9: Status 404 returned error can't find the container with id ae5f9f5364875ac6bb724e5032a2aa1ffda41306f8435ab4aec41d24fd3a7fa9
Jul 01 17:28:35.072286 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:35.072248    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerStarted","Data":"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"}
Jul 01 17:28:35.072516 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:35.072336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerStarted","Data":"ae5f9f5364875ac6bb724e5032a2aa1ffda41306f8435ab4aec41d24fd3a7fa9"}
Jul 01 17:28:35.074953 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:35.074919    2582 generic.go:356] "Generic (PLEG): container finished" podID="36b072f6-c177-41c4-a47d-63563e921665" containerID="497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f" exitCode=2
Jul 01 17:28:35.075081 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:35.074983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerDied","Data":"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"}
Jul 01 17:28:37.670091 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:37.670041    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:28:39.095622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:39.095531    2582 generic.go:356] "Generic (PLEG): container finished" podID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerID="63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa" exitCode=0
Jul 01 17:28:39.095622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:39.095608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerDied","Data":"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"}
Jul 01 17:28:39.680252 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:39.680199    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:28:39.680594 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:39.680565    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:40.102326 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.102291    2582 generic.go:356] "Generic (PLEG): container finished" podID="36b072f6-c177-41c4-a47d-63563e921665" containerID="857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f" exitCode=0
Jul 01 17:28:40.102794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.102363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerDied","Data":"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"}
Jul 01 17:28:40.104825 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.104803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerStarted","Data":"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"}
Jul 01 17:28:40.104956 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.104860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerStarted","Data":"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"}
Jul 01 17:28:40.104956 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.104885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerStarted","Data":"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"}
Jul 01 17:28:40.105175 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.105160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:40.105336 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.105309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:40.106764 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.106743    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:28:40.129909 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:40.129857    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podStartSLOduration=2.3126151090000002 podStartE2EDuration="6.129840253s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.817225144s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:28:40.128988447 +0000 UTC m=+741.902575262" watchObservedRunningTime="2026-07-01 17:28:40.129840253 +0000 UTC m=+741.903427058"
Jul 01 17:28:41.109850 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:41.109801    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:28:41.109850 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:41.109830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:41.111150 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:41.111127    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:42.114851 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:42.114803    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:28:42.115305 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:42.115278    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:42.670143 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:42.670096    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:28:47.119627 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:47.119596    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:28:47.120465 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:47.120416    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:28:47.120690 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:47.120666    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:47.669755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:47.669710    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:28:47.669967 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:47.669852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:28:49.679959 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:49.679912    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:28:49.680368 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:49.680225    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:52.670021 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:52.669971    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:28:57.120915 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:57.120869    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:28:57.121424 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:57.121398    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:57.670310 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:57.670265    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:28:59.680197 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:59.680145    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 17:28:59.680663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:59.680314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:28:59.680663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:59.680414    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:28:59.680663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:28:59.680551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:29:02.669321 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:02.669273    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 17:29:04.579354 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.579329    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:29:04.729583 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k69zm\" (UniqueName: \"kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm\") pod \"36b072f6-c177-41c4-a47d-63563e921665\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") "
Jul 01 17:29:04.729779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") pod \"36b072f6-c177-41c4-a47d-63563e921665\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") "
Jul 01 17:29:04.729779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location\") pod \"36b072f6-c177-41c4-a47d-63563e921665\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") "
Jul 01 17:29:04.729779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert\") pod \"36b072f6-c177-41c4-a47d-63563e921665\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") "
Jul 01 17:29:04.729779 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config\") pod \"36b072f6-c177-41c4-a47d-63563e921665\" (UID: \"36b072f6-c177-41c4-a47d-63563e921665\") "
Jul 01 17:29:04.730023 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.729993    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "36b072f6-c177-41c4-a47d-63563e921665" (UID: "36b072f6-c177-41c4-a47d-63563e921665"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:29:04.730070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.730039    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "36b072f6-c177-41c4-a47d-63563e921665" (UID: "36b072f6-c177-41c4-a47d-63563e921665"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:29:04.730151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.730118    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "36b072f6-c177-41c4-a47d-63563e921665" (UID: "36b072f6-c177-41c4-a47d-63563e921665"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:29:04.732113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.732089    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "36b072f6-c177-41c4-a47d-63563e921665" (UID: "36b072f6-c177-41c4-a47d-63563e921665"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:29:04.732113 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.732102    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm" (OuterVolumeSpecName: "kube-api-access-k69zm") pod "36b072f6-c177-41c4-a47d-63563e921665" (UID: "36b072f6-c177-41c4-a47d-63563e921665"). InnerVolumeSpecName "kube-api-access-k69zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:29:04.830372 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.830337    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/36b072f6-c177-41c4-a47d-63563e921665-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:29:04.830372 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.830365    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36b072f6-c177-41c4-a47d-63563e921665-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:29:04.830372 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.830374    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:29:04.830372 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.830383    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/36b072f6-c177-41c4-a47d-63563e921665-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:29:04.830657 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:04.830392    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k69zm\" (UniqueName: \"kubernetes.io/projected/36b072f6-c177-41c4-a47d-63563e921665-kube-api-access-k69zm\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:29:05.238199 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.238156    2582 generic.go:356] "Generic (PLEG): container finished" podID="36b072f6-c177-41c4-a47d-63563e921665" containerID="903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8" exitCode=0
Jul 01 17:29:05.238379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.238227    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"
Jul 01 17:29:05.238379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.238251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerDied","Data":"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"}
Jul 01 17:29:05.238379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.238327    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2" event={"ID":"36b072f6-c177-41c4-a47d-63563e921665","Type":"ContainerDied","Data":"15ff92f3536b0c6a2c0f710f9b868fa4a84d96f2ed488cf0198d245c084443d5"}
Jul 01 17:29:05.238379 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.238359    2582 scope.go:117] "RemoveContainer" containerID="903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"
Jul 01 17:29:05.250913 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.250890    2582 scope.go:117] "RemoveContainer" containerID="497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"
Jul 01 17:29:05.259702 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.259679    2582 scope.go:117] "RemoveContainer" containerID="857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"
Jul 01 17:29:05.267483 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.267434    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:29:05.270692 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.270663    2582 scope.go:117] "RemoveContainer" containerID="1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"
Jul 01 17:29:05.271651 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.271628    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-55df77c9bd-w5fb2"]
Jul 01 17:29:05.281123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.281105    2582 scope.go:117] "RemoveContainer" containerID="903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"
Jul 01 17:29:05.281440 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:29:05.281420    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8\": container with ID starting with 903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8 not found: ID does not exist" containerID="903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"
Jul 01 17:29:05.281519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.281470    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8"} err="failed to get container status \"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8\": rpc error: code = NotFound desc = could not find container \"903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8\": container with ID starting with 903b3b7a37028c492346eca1c96ced848848d3de1725292ab751bea0207b4dd8 not found: ID does not exist"
Jul 01 17:29:05.281519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.281494    2582 scope.go:117] "RemoveContainer" containerID="497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"
Jul 01 17:29:05.281780 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:29:05.281762    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f\": container with ID starting with 497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f not found: ID does not exist" containerID="497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"
Jul 01 17:29:05.281819 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.281789    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f"} err="failed to get container status \"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f\": rpc error: code = NotFound desc = could not find container \"497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f\": container with ID starting with 497b4a55403d9efb4cc5333dcc0071ea2ca07a0d122ca82910c888170e35408f not found: ID does not exist"
Jul 01 17:29:05.281819 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.281806    2582 scope.go:117] "RemoveContainer" containerID="857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"
Jul 01 17:29:05.282075 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:29:05.282059    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f\": container with ID starting with 857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f not found: ID does not exist" containerID="857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"
Jul 01 17:29:05.282130 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.282079    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f"} err="failed to get container status \"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f\": rpc error: code = NotFound desc = could not find container \"857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f\": container with ID starting with 857d2a17afa46704f03cf8b45a6b25d0e4ab791daf6c97c85728ce4d4614cf4f not found: ID does not exist"
Jul 01 17:29:05.282130 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.282095    2582 scope.go:117] "RemoveContainer" containerID="1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"
Jul 01 17:29:05.282344 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:29:05.282328    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82\": container with ID starting with 1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82 not found: ID does not exist" containerID="1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"
Jul 01 17:29:05.282383 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:05.282349    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82"} err="failed to get container status \"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82\": rpc error: code = NotFound desc = could not find container \"1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82\": container with ID starting with 1221ec786ec1b63e0da9f2b9e4e220d9740099e0eabdcc12b9fb3545e4aeab82 not found: ID does not exist"
Jul 01 17:29:06.659132 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:06.659079    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b072f6-c177-41c4-a47d-63563e921665" path="/var/lib/kubelet/pods/36b072f6-c177-41c4-a47d-63563e921665/volumes"
Jul 01 17:29:07.120239 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:07.120195    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:29:07.120623 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:07.120601    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:17.121200 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:17.121148    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:29:17.121641 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:17.121569    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:27.120759 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:27.120706    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:29:27.121300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:27.121082    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:37.120306 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:37.120251    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:29:37.120864 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:37.120663    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:47.120426 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:47.120371    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:29:47.120952 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:47.120790    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:29:57.120666 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:57.120630    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:29:57.121125 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:29:57.120767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:09.633533 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633494    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633860    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy"
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633872    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy"
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633884    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="storage-initializer"
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633889    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="storage-initializer"
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633897    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container"
Jul 01 17:30:09.633927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633903    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container"
Jul 01 17:30:09.634129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633941    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent"
Jul 01 17:30:09.634129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.633947    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent"
Jul 01 17:30:09.634129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.634006    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="agent"
Jul 01 17:30:09.634129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.634013    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kserve-container"
Jul 01 17:30:09.634129 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.634022    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b072f6-c177-41c4-a47d-63563e921665" containerName="kube-rbac-proxy"
Jul 01 17:30:09.636355 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.636337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.639090 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.639064    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\""
Jul 01 17:30:09.639236 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.639126    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\""
Jul 01 17:30:09.648647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.648617    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:30:09.690230 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.690193    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:30:09.690698 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.690666    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" containerID="cri-o://8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723" gracePeriod=30
Jul 01 17:30:09.691059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.691003    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" containerID="cri-o://66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48" gracePeriod=30
Jul 01 17:30:09.691648 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.691134    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" containerID="cri-o://0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4" gracePeriod=30
Jul 01 17:30:09.725162 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.725123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjhk4\" (UniqueName: \"kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.725370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.725192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.725370 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.725242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.825883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.825840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjhk4\" (UniqueName: \"kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.825883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.825892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.826107 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.825924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.826798 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.826713    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.828733 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.828707    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.835404 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.835377    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjhk4\" (UniqueName: \"kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4\") pod \"message-dumper-predictor-6575bcfdfd-499vr\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:09.948404 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:09.948311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:10.089772 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:10.089740    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:30:10.091883 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:30:10.091857    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2aa9c6_234e_4a8a_962d_ff109daab0d3.slice/crio-f74ed0c0e590a6675c13573ecdfa30578f01b076e2a9eb1387c8a2d430026604 WatchSource:0}: Error finding container f74ed0c0e590a6675c13573ecdfa30578f01b076e2a9eb1387c8a2d430026604: Status 404 returned error can't find the container with id f74ed0c0e590a6675c13573ecdfa30578f01b076e2a9eb1387c8a2d430026604
Jul 01 17:30:10.093788 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:10.093769    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:30:10.544908 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:10.544876    2582 generic.go:356] "Generic (PLEG): container finished" podID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerID="0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4" exitCode=2
Jul 01 17:30:10.545106 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:10.544948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerDied","Data":"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"}
Jul 01 17:30:10.546099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:10.546073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerStarted","Data":"f74ed0c0e590a6675c13573ecdfa30578f01b076e2a9eb1387c8a2d430026604"}
Jul 01 17:30:11.553086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:11.553049    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerStarted","Data":"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"}
Jul 01 17:30:11.553512 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:11.553117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerStarted","Data":"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"}
Jul 01 17:30:11.553512 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:11.553150    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:11.571670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:11.571551    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" podStartSLOduration=1.342396564 podStartE2EDuration="2.571533329s" totalImagesPullingTime="1.229136765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:30:11.56991921 +0000 UTC m=+833.343506017" watchObservedRunningTime="2026-07-01 17:30:11.571533329 +0000 UTC m=+833.345120133"
Jul 01 17:30:12.115877 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:12.115835    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:12.557962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:12.557926    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:12.559363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:12.559340    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:15.574352 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:15.574311    2582 generic.go:356] "Generic (PLEG): container finished" podID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerID="8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723" exitCode=0
Jul 01 17:30:15.574758 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:15.574370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerDied","Data":"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"}
Jul 01 17:30:17.115646 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:17.115583    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:17.120986 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:17.120947    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:30:17.121356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:17.121327    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:19.571710 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:19.571679    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:30:22.115359 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:22.115315    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:22.115840 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:22.115505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:27.114951 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:27.114905    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:27.120882 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:27.120843    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:30:27.121192 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:27.121171    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:29.659725 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.659684    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:30:29.663655 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.663634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.667699 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.667675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-predictor-serving-cert\""
Jul 01 17:30:29.667699 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.667687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-kube-rbac-proxy-sar-config\""
Jul 01 17:30:29.673428 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.673402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:30:29.816100 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.816059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.816100 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.816107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbr6t\" (UniqueName: \"kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.816333 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.816188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.816333 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.816224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.816420 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.816341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.917516 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.917381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.917516 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.917430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.917757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.917618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbr6t\" (UniqueName: \"kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.917757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.917669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.917757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.917697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.918059 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.918030    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.918134 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.918114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.918479 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.918406    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.920209 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.920187    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.928659 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.928630    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbr6t\" (UniqueName: \"kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t\") pod \"isvc-logger-predictor-584d77f8bc-cslvw\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:29.975748 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:29.975707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:30.134103 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:30.134071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:30:30.136539 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:30:30.136501    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d15e104_e156_4125_a5de_cb278c620d77.slice/crio-95486796e5c2ab56fb8e2e7d4520843483309b8c84a125b233e0a3e653a9f0ab WatchSource:0}: Error finding container 95486796e5c2ab56fb8e2e7d4520843483309b8c84a125b233e0a3e653a9f0ab: Status 404 returned error can't find the container with id 95486796e5c2ab56fb8e2e7d4520843483309b8c84a125b233e0a3e653a9f0ab
Jul 01 17:30:30.650695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:30.650659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerStarted","Data":"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"}
Jul 01 17:30:30.650895 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:30.650731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerStarted","Data":"95486796e5c2ab56fb8e2e7d4520843483309b8c84a125b233e0a3e653a9f0ab"}
Jul 01 17:30:32.115514 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:32.115445    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:34.671854 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:34.671819    2582 generic.go:356] "Generic (PLEG): container finished" podID="8d15e104-e156-4125-a5de-cb278c620d77" containerID="5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f" exitCode=0
Jul 01 17:30:34.672250 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:34.671897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerDied","Data":"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"}
Jul 01 17:30:35.679587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.679551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerStarted","Data":"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"}
Jul 01 17:30:35.680047 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.679621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerStarted","Data":"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"}
Jul 01 17:30:35.680047 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.679650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerStarted","Data":"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"}
Jul 01 17:30:35.680047 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.679965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:35.680047 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.680015    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:35.681261 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:35.681236    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:30:36.685107 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:36.685076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:36.685548 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:36.685269    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:30:36.686358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:36.686333    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:37.115525 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.115484    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 17:30:37.120989 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.120959    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:5000: connect: connection refused"
Jul 01 17:30:37.121116 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.121086    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:37.121367 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.121346    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:37.121447 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.121435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:37.144857 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.144805    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podStartSLOduration=4.479117945 podStartE2EDuration="8.144788156s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.665670211s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:30:35.706240848 +0000 UTC m=+857.479827653" watchObservedRunningTime="2026-07-01 17:30:37.144788156 +0000 UTC m=+858.918374962"
Jul 01 17:30:37.689676 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.689632    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:30:37.690130 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:37.690107    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:39.884139 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.884111    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:39.905800 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.905770    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6p4l\" (UniqueName: \"kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l\") pod \"b253f24d-ef2d-4016-be94-085ad9f89ddc\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") "
Jul 01 17:30:39.905942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.905831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert\") pod \"b253f24d-ef2d-4016-be94-085ad9f89ddc\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") "
Jul 01 17:30:39.905942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.905859    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls\") pod \"b253f24d-ef2d-4016-be94-085ad9f89ddc\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") "
Jul 01 17:30:39.905942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.905913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location\") pod \"b253f24d-ef2d-4016-be94-085ad9f89ddc\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") "
Jul 01 17:30:39.906086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.905988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config\") pod \"b253f24d-ef2d-4016-be94-085ad9f89ddc\" (UID: \"b253f24d-ef2d-4016-be94-085ad9f89ddc\") "
Jul 01 17:30:39.906294 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.906262    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b253f24d-ef2d-4016-be94-085ad9f89ddc" (UID: "b253f24d-ef2d-4016-be94-085ad9f89ddc"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:30:39.906401 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.906335    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b253f24d-ef2d-4016-be94-085ad9f89ddc" (UID: "b253f24d-ef2d-4016-be94-085ad9f89ddc"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:30:39.906401 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.906360    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b253f24d-ef2d-4016-be94-085ad9f89ddc" (UID: "b253f24d-ef2d-4016-be94-085ad9f89ddc"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:30:39.908194 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.908161    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b253f24d-ef2d-4016-be94-085ad9f89ddc" (UID: "b253f24d-ef2d-4016-be94-085ad9f89ddc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:30:39.908560 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:39.908231    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l" (OuterVolumeSpecName: "kube-api-access-x6p4l") pod "b253f24d-ef2d-4016-be94-085ad9f89ddc" (UID: "b253f24d-ef2d-4016-be94-085ad9f89ddc"). InnerVolumeSpecName "kube-api-access-x6p4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:30:40.007502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.007375    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6p4l\" (UniqueName: \"kubernetes.io/projected/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-api-access-x6p4l\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:30:40.007502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.007432    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:30:40.007502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.007443    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b253f24d-ef2d-4016-be94-085ad9f89ddc-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:30:40.007502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.007479    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b253f24d-ef2d-4016-be94-085ad9f89ddc-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:30:40.007502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.007489    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b253f24d-ef2d-4016-be94-085ad9f89ddc-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:30:40.709120 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.709080    2582 generic.go:356] "Generic (PLEG): container finished" podID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerID="66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48" exitCode=0
Jul 01 17:30:40.709356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.709157    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"
Jul 01 17:30:40.709356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.709161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerDied","Data":"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"}
Jul 01 17:30:40.709356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.709257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr" event={"ID":"b253f24d-ef2d-4016-be94-085ad9f89ddc","Type":"ContainerDied","Data":"ae5f9f5364875ac6bb724e5032a2aa1ffda41306f8435ab4aec41d24fd3a7fa9"}
Jul 01 17:30:40.709356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.709303    2582 scope.go:117] "RemoveContainer" containerID="66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"
Jul 01 17:30:40.720147 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.720125    2582 scope.go:117] "RemoveContainer" containerID="0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"
Jul 01 17:30:40.729891 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.729868    2582 scope.go:117] "RemoveContainer" containerID="8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"
Jul 01 17:30:40.730997 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.730866    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:30:40.735157 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.735126    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-86d46f7bc-zn7dr"]
Jul 01 17:30:40.738679 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.738660    2582 scope.go:117] "RemoveContainer" containerID="63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"
Jul 01 17:30:40.747394 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.747375    2582 scope.go:117] "RemoveContainer" containerID="66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"
Jul 01 17:30:40.747736 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:30:40.747717    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48\": container with ID starting with 66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48 not found: ID does not exist" containerID="66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"
Jul 01 17:30:40.747781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.747747    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48"} err="failed to get container status \"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48\": rpc error: code = NotFound desc = could not find container \"66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48\": container with ID starting with 66bdbf646549a2dd31314c90db75ae58915976fafc50a0a7b58126d86a6bea48 not found: ID does not exist"
Jul 01 17:30:40.747781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.747769    2582 scope.go:117] "RemoveContainer" containerID="0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"
Jul 01 17:30:40.748031 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:30:40.748017    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4\": container with ID starting with 0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4 not found: ID does not exist" containerID="0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"
Jul 01 17:30:40.748079 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.748035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4"} err="failed to get container status \"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4\": rpc error: code = NotFound desc = could not find container \"0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4\": container with ID starting with 0ca07cc31d6e2d31fd46001ed965c3ba48b56afaf725bcc74eb91a95f375c5c4 not found: ID does not exist"
Jul 01 17:30:40.748079 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.748048    2582 scope.go:117] "RemoveContainer" containerID="8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"
Jul 01 17:30:40.748282 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:30:40.748264    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723\": container with ID starting with 8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723 not found: ID does not exist" containerID="8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"
Jul 01 17:30:40.748327 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.748288    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723"} err="failed to get container status \"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723\": rpc error: code = NotFound desc = could not find container \"8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723\": container with ID starting with 8777c056e8ab1286466ee5b6d2880f557d1326c08cdd285eda9b4b634d2f1723 not found: ID does not exist"
Jul 01 17:30:40.748327 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.748304    2582 scope.go:117] "RemoveContainer" containerID="63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"
Jul 01 17:30:40.748560 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:30:40.748540    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa\": container with ID starting with 63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa not found: ID does not exist" containerID="63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"
Jul 01 17:30:40.748662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:40.748563    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa"} err="failed to get container status \"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa\": rpc error: code = NotFound desc = could not find container \"63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa\": container with ID starting with 63c314e2c5a8b3d324673b798ae72219d8dedd0cb1149322f27d5c4707ddd4fa not found: ID does not exist"
Jul 01 17:30:42.660111 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:42.660079    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" path="/var/lib/kubelet/pods/b253f24d-ef2d-4016-be94-085ad9f89ddc/volumes"
Jul 01 17:30:42.694632 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:42.694603    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:30:42.695196 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:42.695149    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:30:42.695582 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:42.695555    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:30:52.695867 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:52.695821    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:30:52.696328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:30:52.696300    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:02.695749 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:02.695694    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:31:02.696221 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:02.696154    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:12.695605 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:12.695501    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:31:12.696123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:12.695944    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:18.673420 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:18.673393    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:31:18.674132 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:18.674115    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:31:22.695742 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:22.695694    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:31:22.696213 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:22.696189    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:32.695587 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:32.695532    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:31:32.696000 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:32.695966    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:42.695539 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:42.695492    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:31:42.696053 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:42.695963    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:31:52.696304 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:52.696272    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:31:52.696869 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:31:52.696664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:04.756361 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:04.756334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-499vr_be2aa9c6-234e-4a8a-962d-ff109daab0d3/kserve-container/0.log"
Jul 01 17:32:05.039261 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.039225    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:32:05.039551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.039522    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" containerID="cri-o://5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54" gracePeriod=30
Jul 01 17:32:05.039629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.039553    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" containerID="cri-o://3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131" gracePeriod=30
Jul 01 17:32:05.039691 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.039637    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" containerID="cri-o://5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889" gracePeriod=30
Jul 01 17:32:05.046206 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.045783    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:32:05.046356 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046337    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent"
Jul 01 17:32:05.046431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046360    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent"
Jul 01 17:32:05.046431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046394    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container"
Jul 01 17:32:05.046431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046404    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container"
Jul 01 17:32:05.046431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046418    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="storage-initializer"
Jul 01 17:32:05.046431 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046427    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="storage-initializer"
Jul 01 17:32:05.046721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy"
Jul 01 17:32:05.046721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046485    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy"
Jul 01 17:32:05.046721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046574    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="agent"
Jul 01 17:32:05.046721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046590    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kserve-container"
Jul 01 17:32:05.046721 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.046601    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b253f24d-ef2d-4016-be94-085ad9f89ddc" containerName="kube-rbac-proxy"
Jul 01 17:32:05.050284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.050255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.053012 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.052991    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-predictor-serving-cert\""
Jul 01 17:32:05.053117 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.053047    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-kube-rbac-proxy-sar-config\""
Jul 01 17:32:05.058822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.058791    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:32:05.092046 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.092011    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:32:05.092339 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.092310    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kserve-container" containerID="cri-o://45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e" gracePeriod=30
Jul 01 17:32:05.092419 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.092389    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kube-rbac-proxy" containerID="cri-o://947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937" gracePeriod=30
Jul 01 17:32:05.097444 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.097408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.097570 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.097490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.097629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.097607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.097684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.097668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfscq\" (UniqueName: \"kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.097990 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.097747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfscq\" (UniqueName: \"kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199254 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199316 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199610 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199584    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.199913 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.199887    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.200262 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.200238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.201977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.201956    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.209037 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.208982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfscq\" (UniqueName: \"kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.340071 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.340044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:32:05.367307 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.367257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:32:05.400796 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.400766    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjhk4\" (UniqueName: \"kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4\") pod \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") "
Jul 01 17:32:05.401001 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.400816    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls\") pod \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") "
Jul 01 17:32:05.401001 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.400837    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config\") pod \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\" (UID: \"be2aa9c6-234e-4a8a-962d-ff109daab0d3\") "
Jul 01 17:32:05.401293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.401263    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "be2aa9c6-234e-4a8a-962d-ff109daab0d3" (UID: "be2aa9c6-234e-4a8a-962d-ff109daab0d3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:32:05.403172 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.403127    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "be2aa9c6-234e-4a8a-962d-ff109daab0d3" (UID: "be2aa9c6-234e-4a8a-962d-ff109daab0d3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:32:05.403274 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.403206    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4" (OuterVolumeSpecName: "kube-api-access-rjhk4") pod "be2aa9c6-234e-4a8a-962d-ff109daab0d3" (UID: "be2aa9c6-234e-4a8a-962d-ff109daab0d3"). InnerVolumeSpecName "kube-api-access-rjhk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:32:05.502212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.502176    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjhk4\" (UniqueName: \"kubernetes.io/projected/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-api-access-rjhk4\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:05.502212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.502208    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be2aa9c6-234e-4a8a-962d-ff109daab0d3-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:05.502212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.502218    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be2aa9c6-234e-4a8a-962d-ff109daab0d3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:05.514339 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:05.514307    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:32:05.516224 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:32:05.516192    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd9c96b_f1de_4781_9501_4d70442079c4.slice/crio-c381dbc23d61f436ade763a9cdd588785255ebcec620cbb92e194d807abb5c50 WatchSource:0}: Error finding container c381dbc23d61f436ade763a9cdd588785255ebcec620cbb92e194d807abb5c50: Status 404 returned error can't find the container with id c381dbc23d61f436ade763a9cdd588785255ebcec620cbb92e194d807abb5c50
Jul 01 17:32:06.123513 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123472    2582 generic.go:356] "Generic (PLEG): container finished" podID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerID="947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937" exitCode=2
Jul 01 17:32:06.123513 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123499    2582 generic.go:356] "Generic (PLEG): container finished" podID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerID="45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e" exitCode=2
Jul 01 17:32:06.124075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"
Jul 01 17:32:06.124075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerDied","Data":"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"}
Jul 01 17:32:06.124075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerDied","Data":"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"}
Jul 01 17:32:06.124075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr" event={"ID":"be2aa9c6-234e-4a8a-962d-ff109daab0d3","Type":"ContainerDied","Data":"f74ed0c0e590a6675c13573ecdfa30578f01b076e2a9eb1387c8a2d430026604"}
Jul 01 17:32:06.124075 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.123687    2582 scope.go:117] "RemoveContainer" containerID="947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"
Jul 01 17:32:06.127465 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.127402    2582 generic.go:356] "Generic (PLEG): container finished" podID="8d15e104-e156-4125-a5de-cb278c620d77" containerID="5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889" exitCode=2
Jul 01 17:32:06.127621 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.127500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerDied","Data":"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"}
Jul 01 17:32:06.129492 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.129443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerStarted","Data":"75e73b22404bb3dfb1228e90fadc898f363c8da01bda44a080dac53aba85c90e"}
Jul 01 17:32:06.129647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.129525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerStarted","Data":"c381dbc23d61f436ade763a9cdd588785255ebcec620cbb92e194d807abb5c50"}
Jul 01 17:32:06.135427 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.135404    2582 scope.go:117] "RemoveContainer" containerID="45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"
Jul 01 17:32:06.144239 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.144217    2582 scope.go:117] "RemoveContainer" containerID="947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"
Jul 01 17:32:06.144663 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:06.144644    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937\": container with ID starting with 947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937 not found: ID does not exist" containerID="947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"
Jul 01 17:32:06.144737 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.144673    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"} err="failed to get container status \"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937\": rpc error: code = NotFound desc = could not find container \"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937\": container with ID starting with 947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937 not found: ID does not exist"
Jul 01 17:32:06.144737 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.144692    2582 scope.go:117] "RemoveContainer" containerID="45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"
Jul 01 17:32:06.144963 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:06.144949    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e\": container with ID starting with 45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e not found: ID does not exist" containerID="45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"
Jul 01 17:32:06.145000 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.144970    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"} err="failed to get container status \"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e\": rpc error: code = NotFound desc = could not find container \"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e\": container with ID starting with 45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e not found: ID does not exist"
Jul 01 17:32:06.145000 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.144983    2582 scope.go:117] "RemoveContainer" containerID="947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"
Jul 01 17:32:06.145270 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.145249    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937"} err="failed to get container status \"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937\": rpc error: code = NotFound desc = could not find container \"947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937\": container with ID starting with 947d3fc9f24ec16864fea8bf9538c3988149a18c2ac42ec014540c857979d937 not found: ID does not exist"
Jul 01 17:32:06.145311 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.145274    2582 scope.go:117] "RemoveContainer" containerID="45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"
Jul 01 17:32:06.145543 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.145527    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e"} err="failed to get container status \"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e\": rpc error: code = NotFound desc = could not find container \"45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e\": container with ID starting with 45fecae61181dacc6779f00d5e2ffcd4f3ee1dee28ce4713a3e96af25796898e not found: ID does not exist"
Jul 01 17:32:06.167202 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.167161    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:32:06.172805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.172773    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-499vr"]
Jul 01 17:32:06.659811 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:06.659773    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" path="/var/lib/kubelet/pods/be2aa9c6-234e-4a8a-962d-ff109daab0d3/volumes"
Jul 01 17:32:07.690540 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:07.690492    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:11.157604 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:11.157567    2582 generic.go:356] "Generic (PLEG): container finished" podID="8d15e104-e156-4125-a5de-cb278c620d77" containerID="5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54" exitCode=0
Jul 01 17:32:11.157977 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:11.157642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerDied","Data":"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"}
Jul 01 17:32:12.690391 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:12.690341    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:12.695863 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:12.695818    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:32:12.696208 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:12.696180    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:32:17.690549 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:17.690496    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:17.690938 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:17.690638    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:22.690796 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:22.690742    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:22.695162 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:22.695121    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:32:22.695515 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:22.695488    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:32:27.690629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:27.690573    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:32.690588 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:32.690541    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 17:32:32.695995 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:32.695961    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 17:32:32.696153 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:32.696101    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:32.696395 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:32.696374    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 17:32:32.696502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:32.696490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:35.210955 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.210919    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:35.277210 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.277179    2582 generic.go:356] "Generic (PLEG): container finished" podID="8d15e104-e156-4125-a5de-cb278c620d77" containerID="3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131" exitCode=0
Jul 01 17:32:35.277397 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.277244    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"
Jul 01 17:32:35.277397 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.277247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerDied","Data":"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"}
Jul 01 17:32:35.277397 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.277379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw" event={"ID":"8d15e104-e156-4125-a5de-cb278c620d77","Type":"ContainerDied","Data":"95486796e5c2ab56fb8e2e7d4520843483309b8c84a125b233e0a3e653a9f0ab"}
Jul 01 17:32:35.277530 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.277413    2582 scope.go:117] "RemoveContainer" containerID="3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"
Jul 01 17:32:35.286274 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.286254    2582 scope.go:117] "RemoveContainer" containerID="5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"
Jul 01 17:32:35.294947 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.294925    2582 scope.go:117] "RemoveContainer" containerID="5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"
Jul 01 17:32:35.303553 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.303531    2582 scope.go:117] "RemoveContainer" containerID="5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"
Jul 01 17:32:35.312805 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.312784    2582 scope.go:117] "RemoveContainer" containerID="3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"
Jul 01 17:32:35.313166 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:35.313146    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131\": container with ID starting with 3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131 not found: ID does not exist" containerID="3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"
Jul 01 17:32:35.313227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313177    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131"} err="failed to get container status \"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131\": rpc error: code = NotFound desc = could not find container \"3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131\": container with ID starting with 3338de81dd23d4c88fecd9f1a1eebf383692cf8a5a4983d6c5eb13dba3031131 not found: ID does not exist"
Jul 01 17:32:35.313227 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313200    2582 scope.go:117] "RemoveContainer" containerID="5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"
Jul 01 17:32:35.313516 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:35.313492    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889\": container with ID starting with 5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889 not found: ID does not exist" containerID="5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"
Jul 01 17:32:35.313645 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313524    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889"} err="failed to get container status \"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889\": rpc error: code = NotFound desc = could not find container \"5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889\": container with ID starting with 5ffe86ae6295f0d6708e2fa52a9b3d2c72c20d9349009afa085de3e51f806889 not found: ID does not exist"
Jul 01 17:32:35.313645 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313542    2582 scope.go:117] "RemoveContainer" containerID="5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"
Jul 01 17:32:35.313789 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:35.313772    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54\": container with ID starting with 5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54 not found: ID does not exist" containerID="5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"
Jul 01 17:32:35.313830 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313793    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54"} err="failed to get container status \"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54\": rpc error: code = NotFound desc = could not find container \"5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54\": container with ID starting with 5013c9e2ee51ad4f912b3445231fc8c973121856a753fece5252ea18ac76cb54 not found: ID does not exist"
Jul 01 17:32:35.313830 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.313808    2582 scope.go:117] "RemoveContainer" containerID="5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"
Jul 01 17:32:35.314089 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:32:35.314045    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f\": container with ID starting with 5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f not found: ID does not exist" containerID="5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"
Jul 01 17:32:35.314155 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.314095    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f"} err="failed to get container status \"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f\": rpc error: code = NotFound desc = could not find container \"5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f\": container with ID starting with 5ef960d438ae6c4951d178fed9443b871d82d7c3ed0c510f2455b7bab6e4201f not found: ID does not exist"
Jul 01 17:32:35.386663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.386631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert\") pod \"8d15e104-e156-4125-a5de-cb278c620d77\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") "
Jul 01 17:32:35.386842 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.386684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls\") pod \"8d15e104-e156-4125-a5de-cb278c620d77\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") "
Jul 01 17:32:35.386842 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.386750    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location\") pod \"8d15e104-e156-4125-a5de-cb278c620d77\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") "
Jul 01 17:32:35.386842 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.386834    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbr6t\" (UniqueName: \"kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t\") pod \"8d15e104-e156-4125-a5de-cb278c620d77\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") "
Jul 01 17:32:35.387011 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.386860    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config\") pod \"8d15e104-e156-4125-a5de-cb278c620d77\" (UID: \"8d15e104-e156-4125-a5de-cb278c620d77\") "
Jul 01 17:32:35.387174 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.387144    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8d15e104-e156-4125-a5de-cb278c620d77" (UID: "8d15e104-e156-4125-a5de-cb278c620d77"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:32:35.387249 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.387180    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8d15e104-e156-4125-a5de-cb278c620d77" (UID: "8d15e104-e156-4125-a5de-cb278c620d77"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:32:35.387296 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.387242    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8d15e104-e156-4125-a5de-cb278c620d77" (UID: "8d15e104-e156-4125-a5de-cb278c620d77"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:32:35.389750 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.389711    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8d15e104-e156-4125-a5de-cb278c620d77" (UID: "8d15e104-e156-4125-a5de-cb278c620d77"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:32:35.389863 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.389715    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t" (OuterVolumeSpecName: "kube-api-access-lbr6t") pod "8d15e104-e156-4125-a5de-cb278c620d77" (UID: "8d15e104-e156-4125-a5de-cb278c620d77"). InnerVolumeSpecName "kube-api-access-lbr6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:32:35.488343 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.488298    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbr6t\" (UniqueName: \"kubernetes.io/projected/8d15e104-e156-4125-a5de-cb278c620d77-kube-api-access-lbr6t\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:35.488343 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.488336    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:35.488343 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.488348    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8d15e104-e156-4125-a5de-cb278c620d77-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:35.488343 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.488356    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8d15e104-e156-4125-a5de-cb278c620d77-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:35.488666 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.488365    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d15e104-e156-4125-a5de-cb278c620d77-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:32:35.608330 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.608286    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:32:35.613599 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:35.613570    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-584d77f8bc-cslvw"]
Jul 01 17:32:36.284517 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:36.284472    2582 generic.go:356] "Generic (PLEG): container finished" podID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerID="75e73b22404bb3dfb1228e90fadc898f363c8da01bda44a080dac53aba85c90e" exitCode=0
Jul 01 17:32:36.284917 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:36.284545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerDied","Data":"75e73b22404bb3dfb1228e90fadc898f363c8da01bda44a080dac53aba85c90e"}
Jul 01 17:32:36.659918 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:32:36.659816    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d15e104-e156-4125-a5de-cb278c620d77" path="/var/lib/kubelet/pods/8d15e104-e156-4125-a5de-cb278c620d77/volumes"
Jul 01 17:35:18.100973 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:18.100929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerStarted","Data":"94de334607df81a69eb2747c9539e1afbd8cdc09454d1f52d1cb17d63e278956"}
Jul 01 17:35:19.109023 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:19.108985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerStarted","Data":"e8e7d3e601ac5b5d8ebc1d29610a46479a9e8a2096ecbcf57c39b44821575ead"}
Jul 01 17:35:19.109473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:19.109137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:19.135765 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:19.135699    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podStartSLOduration=2.5044560479999998 podStartE2EDuration="3m14.135674725s" totalImagesPullingTime="2m41.591253478s" totalInitContainerRuntime="30.039965199s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:35:19.133360127 +0000 UTC m=+1140.906946932" watchObservedRunningTime="2026-07-01 17:35:19.135674725 +0000 UTC m=+1140.909261528"
Jul 01 17:35:20.113613 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:20.113578    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:20.115163 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:20.115134    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 17:35:21.118194 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:21.118150    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 17:35:26.124784 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:26.124754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:26.125389 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:26.125180    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 17:35:36.126621 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:36.126586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:45.258209 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:45.258116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:35:45.258868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:45.258382    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container" containerID="cri-o://94de334607df81a69eb2747c9539e1afbd8cdc09454d1f52d1cb17d63e278956" gracePeriod=30
Jul 01 17:35:45.258868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:45.258413    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kube-rbac-proxy" containerID="cri-o://e8e7d3e601ac5b5d8ebc1d29610a46479a9e8a2096ecbcf57c39b44821575ead" gracePeriod=30
Jul 01 17:35:46.118806 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.118756    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Jul 01 17:35:46.125998 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.125959    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 17:35:46.242188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.242138    2582 generic.go:356] "Generic (PLEG): container finished" podID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerID="e8e7d3e601ac5b5d8ebc1d29610a46479a9e8a2096ecbcf57c39b44821575ead" exitCode=2
Jul 01 17:35:46.242188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.242178    2582 generic.go:356] "Generic (PLEG): container finished" podID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerID="94de334607df81a69eb2747c9539e1afbd8cdc09454d1f52d1cb17d63e278956" exitCode=0
Jul 01 17:35:46.242188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.242180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerDied","Data":"e8e7d3e601ac5b5d8ebc1d29610a46479a9e8a2096ecbcf57c39b44821575ead"}
Jul 01 17:35:46.242538 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.242240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerDied","Data":"94de334607df81a69eb2747c9539e1afbd8cdc09454d1f52d1cb17d63e278956"}
Jul 01 17:35:46.336000 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.335917    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:46.420180 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config\") pod \"bfd9c96b-f1de-4781-9501-4d70442079c4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") "
Jul 01 17:35:46.420363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420233    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert\") pod \"bfd9c96b-f1de-4781-9501-4d70442079c4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") "
Jul 01 17:35:46.420363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420276    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls\") pod \"bfd9c96b-f1de-4781-9501-4d70442079c4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") "
Jul 01 17:35:46.420363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420296    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location\") pod \"bfd9c96b-f1de-4781-9501-4d70442079c4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") "
Jul 01 17:35:46.420363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfscq\" (UniqueName: \"kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq\") pod \"bfd9c96b-f1de-4781-9501-4d70442079c4\" (UID: \"bfd9c96b-f1de-4781-9501-4d70442079c4\") "
Jul 01 17:35:46.420679 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420652    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "bfd9c96b-f1de-4781-9501-4d70442079c4" (UID: "bfd9c96b-f1de-4781-9501-4d70442079c4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:35:46.420744 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.420669    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bfd9c96b-f1de-4781-9501-4d70442079c4" (UID: "bfd9c96b-f1de-4781-9501-4d70442079c4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:35:46.422665 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.422623    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bfd9c96b-f1de-4781-9501-4d70442079c4" (UID: "bfd9c96b-f1de-4781-9501-4d70442079c4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:35:46.422793 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.422771    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq" (OuterVolumeSpecName: "kube-api-access-rfscq") pod "bfd9c96b-f1de-4781-9501-4d70442079c4" (UID: "bfd9c96b-f1de-4781-9501-4d70442079c4"). InnerVolumeSpecName "kube-api-access-rfscq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:35:46.423575 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.423546    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bfd9c96b-f1de-4781-9501-4d70442079c4" (UID: "bfd9c96b-f1de-4781-9501-4d70442079c4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:35:46.521861 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.521825    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:35:46.521861 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.521854    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bfd9c96b-f1de-4781-9501-4d70442079c4-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:35:46.521861 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.521864    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfd9c96b-f1de-4781-9501-4d70442079c4-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:35:46.522108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.521874    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfscq\" (UniqueName: \"kubernetes.io/projected/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-api-access-rfscq\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:35:46.522108 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:46.521883    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bfd9c96b-f1de-4781-9501-4d70442079c4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:35:47.248723 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.248687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4" event={"ID":"bfd9c96b-f1de-4781-9501-4d70442079c4","Type":"ContainerDied","Data":"c381dbc23d61f436ade763a9cdd588785255ebcec620cbb92e194d807abb5c50"}
Jul 01 17:35:47.248898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.248729    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"
Jul 01 17:35:47.248898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.248772    2582 scope.go:117] "RemoveContainer" containerID="e8e7d3e601ac5b5d8ebc1d29610a46479a9e8a2096ecbcf57c39b44821575ead"
Jul 01 17:35:47.258755 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.258733    2582 scope.go:117] "RemoveContainer" containerID="94de334607df81a69eb2747c9539e1afbd8cdc09454d1f52d1cb17d63e278956"
Jul 01 17:35:47.266872 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.266850    2582 scope.go:117] "RemoveContainer" containerID="75e73b22404bb3dfb1228e90fadc898f363c8da01bda44a080dac53aba85c90e"
Jul 01 17:35:47.268373 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.268355    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:35:47.272022 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:47.272003    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-g8fh4"]
Jul 01 17:35:48.660851 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:48.660812    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" path="/var/lib/kubelet/pods/bfd9c96b-f1de-4781-9501-4d70442079c4/volumes"
Jul 01 17:35:50.625285 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625251    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625704    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="storage-initializer"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625724    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="storage-initializer"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625736    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625744    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625757    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kube-rbac-proxy"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625766    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kube-rbac-proxy"
Jul 01 17:35:50.625778 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625780    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625789    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625798    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625803    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625809    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625813    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625822    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="storage-initializer"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625829    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="storage-initializer"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625844    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625849    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625857    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625866    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625949    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625959    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625966    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd9c96b-f1de-4781-9501-4d70442079c4" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625972    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625978    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kserve-container"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2aa9c6-234e-4a8a-962d-ff109daab0d3" containerName="kube-rbac-proxy"
Jul 01 17:35:50.626099 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.625990    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d15e104-e156-4125-a5de-cb278c620d77" containerName="agent"
Jul 01 17:35:50.650819 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.650784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:35:50.651154 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.651131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.657402 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.657372    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:35:50.657550 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.657528    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l8gxp\""
Jul 01 17:35:50.657700 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.657388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:35:50.657740 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.657697    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-kube-rbac-proxy-sar-config\""
Jul 01 17:35:50.657963 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.657946    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:35:50.658572 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.658553    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-predictor-serving-cert\""
Jul 01 17:35:50.658675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.658612    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:35:50.765280 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.765231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.765529 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.765317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.765529 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.765374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shltl\" (UniqueName: \"kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.765529 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.765424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.765529 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.765468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.866768 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.866728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shltl\" (UniqueName: \"kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.866976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.866777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.866976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.866798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.866976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.866850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.866976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.866893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.867419 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.867393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.867684 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.867663    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.867743 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.867667    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.869558 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.869537    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.875948 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.875858    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shltl\" (UniqueName: \"kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl\") pod \"isvc-autogluon-v2-predictor-67b849d456-42vww\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:50.970203 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:50.970153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:51.177406 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:51.177376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:35:51.179955 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:35:51.179922    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561b443a_fe33_4e75_8da7_f8880afbb0ec.slice/crio-304a9b592f858e8438bf20e6976f8272e602e2dd5130678bf362dcd80da388cb WatchSource:0}: Error finding container 304a9b592f858e8438bf20e6976f8272e602e2dd5130678bf362dcd80da388cb: Status 404 returned error can't find the container with id 304a9b592f858e8438bf20e6976f8272e602e2dd5130678bf362dcd80da388cb
Jul 01 17:35:51.279416 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:51.279387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerStarted","Data":"304a9b592f858e8438bf20e6976f8272e602e2dd5130678bf362dcd80da388cb"}
Jul 01 17:35:52.289629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:52.289575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerStarted","Data":"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"}
Jul 01 17:35:56.312210 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:56.312174    2582 generic.go:356] "Generic (PLEG): container finished" podID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerID="b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451" exitCode=0
Jul 01 17:35:56.312634 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:56.312230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerDied","Data":"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"}
Jul 01 17:35:57.322931 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:57.322895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerStarted","Data":"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"}
Jul 01 17:35:57.323358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:57.322957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerStarted","Data":"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"}
Jul 01 17:35:57.323358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:57.323291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:57.323358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:57.323350    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:35:57.342836 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:35:57.342780    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" podStartSLOduration=2.538400682 podStartE2EDuration="7.342764743s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.804364061s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:35:57.341310482 +0000 UTC m=+1179.114897286" watchObservedRunningTime="2026-07-01 17:35:57.342764743 +0000 UTC m=+1179.116351546"
Jul 01 17:36:03.333122 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:36:03.333081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:36:18.704829 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:36:18.704801    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:36:18.705600 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:36:18.705579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:37:32.659080 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:32.658997    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:37:40.780475 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:40.780432    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:37:40.780957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:40.780671    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kserve-container" containerID="cri-o://09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d" gracePeriod=30
Jul 01 17:37:40.780957 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:40.780745    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kube-rbac-proxy" containerID="cri-o://3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560" gracePeriod=30
Jul 01 17:37:41.609824 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.609803    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:37:41.620158 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620139    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config\") pod \"561b443a-fe33-4e75-8da7-f8880afbb0ec\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") "
Jul 01 17:37:41.620264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shltl\" (UniqueName: \"kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl\") pod \"561b443a-fe33-4e75-8da7-f8880afbb0ec\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") "
Jul 01 17:37:41.620264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620200    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert\") pod \"561b443a-fe33-4e75-8da7-f8880afbb0ec\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") "
Jul 01 17:37:41.620264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620216    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls\") pod \"561b443a-fe33-4e75-8da7-f8880afbb0ec\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") "
Jul 01 17:37:41.620264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620247    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location\") pod \"561b443a-fe33-4e75-8da7-f8880afbb0ec\" (UID: \"561b443a-fe33-4e75-8da7-f8880afbb0ec\") "
Jul 01 17:37:41.620581 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620554    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "561b443a-fe33-4e75-8da7-f8880afbb0ec" (UID: "561b443a-fe33-4e75-8da7-f8880afbb0ec"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:37:41.620581 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.620565    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "561b443a-fe33-4e75-8da7-f8880afbb0ec" (UID: "561b443a-fe33-4e75-8da7-f8880afbb0ec"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:37:41.622315 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.622290    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "561b443a-fe33-4e75-8da7-f8880afbb0ec" (UID: "561b443a-fe33-4e75-8da7-f8880afbb0ec"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:37:41.622401 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.622335    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl" (OuterVolumeSpecName: "kube-api-access-shltl") pod "561b443a-fe33-4e75-8da7-f8880afbb0ec" (UID: "561b443a-fe33-4e75-8da7-f8880afbb0ec"). InnerVolumeSpecName "kube-api-access-shltl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:37:41.626595 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.626569    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "561b443a-fe33-4e75-8da7-f8880afbb0ec" (UID: "561b443a-fe33-4e75-8da7-f8880afbb0ec"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:37:41.721500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.721415    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:37:41.721500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.721468    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shltl\" (UniqueName: \"kubernetes.io/projected/561b443a-fe33-4e75-8da7-f8880afbb0ec-kube-api-access-shltl\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:37:41.721500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.721478    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/561b443a-fe33-4e75-8da7-f8880afbb0ec-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:37:41.721500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.721487    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/561b443a-fe33-4e75-8da7-f8880afbb0ec-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:37:41.721500 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.721495    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/561b443a-fe33-4e75-8da7-f8880afbb0ec-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:37:41.778520 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778494    2582 generic.go:356] "Generic (PLEG): container finished" podID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerID="3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560" exitCode=2
Jul 01 17:37:41.778520 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778515    2582 generic.go:356] "Generic (PLEG): container finished" podID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerID="09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d" exitCode=0
Jul 01 17:37:41.778635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerDied","Data":"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"}
Jul 01 17:37:41.778635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778555    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"
Jul 01 17:37:41.778635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerDied","Data":"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"}
Jul 01 17:37:41.778635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww" event={"ID":"561b443a-fe33-4e75-8da7-f8880afbb0ec","Type":"ContainerDied","Data":"304a9b592f858e8438bf20e6976f8272e602e2dd5130678bf362dcd80da388cb"}
Jul 01 17:37:41.778635 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.778622    2582 scope.go:117] "RemoveContainer" containerID="3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"
Jul 01 17:37:41.787151 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.786952    2582 scope.go:117] "RemoveContainer" containerID="09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"
Jul 01 17:37:41.794769 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.794751    2582 scope.go:117] "RemoveContainer" containerID="b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"
Jul 01 17:37:41.801766 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.801753    2582 scope.go:117] "RemoveContainer" containerID="3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"
Jul 01 17:37:41.802007 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:37:41.801989    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560\": container with ID starting with 3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560 not found: ID does not exist" containerID="3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"
Jul 01 17:37:41.802063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802015    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"} err="failed to get container status \"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560\": rpc error: code = NotFound desc = could not find container \"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560\": container with ID starting with 3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560 not found: ID does not exist"
Jul 01 17:37:41.802063 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802032    2582 scope.go:117] "RemoveContainer" containerID="09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"
Jul 01 17:37:41.802318 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:37:41.802299    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d\": container with ID starting with 09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d not found: ID does not exist" containerID="09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"
Jul 01 17:37:41.802392 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802326    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"} err="failed to get container status \"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d\": rpc error: code = NotFound desc = could not find container \"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d\": container with ID starting with 09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d not found: ID does not exist"
Jul 01 17:37:41.802392 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802345    2582 scope.go:117] "RemoveContainer" containerID="b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"
Jul 01 17:37:41.802690 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:37:41.802651    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451\": container with ID starting with b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451 not found: ID does not exist" containerID="b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"
Jul 01 17:37:41.802690 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802683    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"} err="failed to get container status \"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451\": rpc error: code = NotFound desc = could not find container \"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451\": container with ID starting with b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451 not found: ID does not exist"
Jul 01 17:37:41.802848 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.802703    2582 scope.go:117] "RemoveContainer" containerID="3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"
Jul 01 17:37:41.803126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.803099    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560"} err="failed to get container status \"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560\": rpc error: code = NotFound desc = could not find container \"3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560\": container with ID starting with 3ca62157e271f152fa6833c628b27b84d64460511e56b06e946133aa3e5ff560 not found: ID does not exist"
Jul 01 17:37:41.803216 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.803156    2582 scope.go:117] "RemoveContainer" containerID="09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"
Jul 01 17:37:41.803421 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.803404    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d"} err="failed to get container status \"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d\": rpc error: code = NotFound desc = could not find container \"09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d\": container with ID starting with 09e16d7c4aea35ba2208595010491df129daabb2dc07b56811a248197b9b552d not found: ID does not exist"
Jul 01 17:37:41.803575 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.803445    2582 scope.go:117] "RemoveContainer" containerID="b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"
Jul 01 17:37:41.803716 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.803689    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451"} err="failed to get container status \"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451\": rpc error: code = NotFound desc = could not find container \"b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451\": container with ID starting with b6dad9a6e40be651ca5ea9a4f92bd69f1930f5b880db807159bf9d52182b6451 not found: ID does not exist"
Jul 01 17:37:41.804811 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.804795    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:37:41.808546 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:41.808527    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-42vww"]
Jul 01 17:37:42.658638 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:42.658606    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" path="/var/lib/kubelet/pods/561b443a-fe33-4e75-8da7-f8880afbb0ec/volumes"
Jul 01 17:37:45.914855 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.914824    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:37:45.915198 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915164    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kserve-container"
Jul 01 17:37:45.915198 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915175    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kserve-container"
Jul 01 17:37:45.915198 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915188    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kube-rbac-proxy"
Jul 01 17:37:45.915198 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915194    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kube-rbac-proxy"
Jul 01 17:37:45.915319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915208    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="storage-initializer"
Jul 01 17:37:45.915319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915214    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="storage-initializer"
Jul 01 17:37:45.915319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915269    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kube-rbac-proxy"
Jul 01 17:37:45.915319 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.915279    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="561b443a-fe33-4e75-8da7-f8880afbb0ec" containerName="kserve-container"
Jul 01 17:37:45.917427 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.917411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:45.920212 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.920192    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-predictor-serving-cert\""
Jul 01 17:37:45.920441 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.920426    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:37:45.920781 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.920764    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-kube-rbac-proxy-sar-config\""
Jul 01 17:37:45.920846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.920780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:37:45.921626 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.921612    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:37:45.921713 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.921643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l8gxp\""
Jul 01 17:37:45.921898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.921881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:37:45.928086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.928067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:37:45.949150 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.949130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:45.949231 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.949155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:45.949231 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.949191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:45.949304 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.949278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:45.949358 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:45.949344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.049822 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.049797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.049927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.049843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.049927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.049886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.049927 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.049910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.050053 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:37:46.049955    2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-serving-cert: secret "isvc-autogluon-v2-variants-predictor-serving-cert" not found
Jul 01 17:37:46.050053 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:37:46.050013    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls podName:77d9b883-a32f-4200-abd5-cae9fb7c7a2d nodeName:}" failed. No retries permitted until 2026-07-01 17:37:46.549994714 +0000 UTC m=+1288.323581498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls") pod "isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d") : secret "isvc-autogluon-v2-variants-predictor-serving-cert" not found
Jul 01 17:37:46.050156 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.050059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.050439 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.050414    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.050513 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.050499    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.050604 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.050586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.061111 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.061091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.552658 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.552626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.555121 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.555088    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.828043 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.827972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:37:46.954914 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:46.954892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:37:46.956818 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:37:46.956793    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d9b883_a32f_4200_abd5_cae9fb7c7a2d.slice/crio-202bd5a8682866eb9299748c7ed8d66d7fb7b00b86114c0cb6838751e73f6fb8 WatchSource:0}: Error finding container 202bd5a8682866eb9299748c7ed8d66d7fb7b00b86114c0cb6838751e73f6fb8: Status 404 returned error can't find the container with id 202bd5a8682866eb9299748c7ed8d66d7fb7b00b86114c0cb6838751e73f6fb8
Jul 01 17:37:47.805782 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:47.805738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerStarted","Data":"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"}
Jul 01 17:37:47.805939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:37:47.805804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerStarted","Data":"202bd5a8682866eb9299748c7ed8d66d7fb7b00b86114c0cb6838751e73f6fb8"}
Jul 01 17:38:16.934320 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:16.934288    2582 generic.go:356] "Generic (PLEG): container finished" podID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerID="95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35" exitCode=0
Jul 01 17:38:16.934686 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:16.934353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerDied","Data":"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"}
Jul 01 17:38:17.944288 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:17.944256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerStarted","Data":"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"}
Jul 01 17:38:17.944670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:17.944349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerStarted","Data":"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"}
Jul 01 17:38:17.944670 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:17.944558    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:38:17.967594 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:17.967551    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" podStartSLOduration=3.143927726 podStartE2EDuration="32.967536416s" totalImagesPullingTime="0s" totalInitContainerRuntime="29.82360869s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:38:17.964856865 +0000 UTC m=+1319.738443679" watchObservedRunningTime="2026-07-01 17:38:17.967536416 +0000 UTC m=+1319.741123220"
Jul 01 17:38:18.949183 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:18.949156    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:38:24.958678 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:38:24.958650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:39:53.657901 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:53.657868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:39:56.117851 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.117816    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:39:56.118255 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.118045    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kserve-container" containerID="cri-o://51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19" gracePeriod=30
Jul 01 17:39:56.118255 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.118077    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kube-rbac-proxy" containerID="cri-o://c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb" gracePeriod=30
Jul 01 17:39:56.357334 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.357301    2582 generic.go:356] "Generic (PLEG): container finished" podID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerID="c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb" exitCode=2
Jul 01 17:39:56.357532 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.357380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerDied","Data":"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"}
Jul 01 17:39:56.970483 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:56.970441    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:39:57.014001 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.013966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert\") pod \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") "
Jul 01 17:39:57.014181 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location\") pod \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") "
Jul 01 17:39:57.014181 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014102    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4\") pod \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") "
Jul 01 17:39:57.014181 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") pod \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") "
Jul 01 17:39:57.014352 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config\") pod \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\" (UID: \"77d9b883-a32f-4200-abd5-cae9fb7c7a2d\") "
Jul 01 17:39:57.014352 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014309    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "77d9b883-a32f-4200-abd5-cae9fb7c7a2d" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:39:57.014662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014605    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:39:57.014662 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.014632    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "77d9b883-a32f-4200-abd5-cae9fb7c7a2d" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:39:57.016274 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.016252    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4" (OuterVolumeSpecName: "kube-api-access-5znn4") pod "77d9b883-a32f-4200-abd5-cae9fb7c7a2d" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d"). InnerVolumeSpecName "kube-api-access-5znn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:39:57.016629 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.016608    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "77d9b883-a32f-4200-abd5-cae9fb7c7a2d" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:39:57.019601 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.019582    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "77d9b883-a32f-4200-abd5-cae9fb7c7a2d" (UID: "77d9b883-a32f-4200-abd5-cae9fb7c7a2d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:39:57.115524 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.115492    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-api-access-5znn4\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:39:57.115524 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.115517    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:39:57.115524 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.115529    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:39:57.115762 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.115539    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77d9b883-a32f-4200-abd5-cae9fb7c7a2d-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:39:57.363973 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.363875    2582 generic.go:356] "Generic (PLEG): container finished" podID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerID="51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19" exitCode=0
Jul 01 17:39:57.363973 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.363931    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"
Jul 01 17:39:57.363973 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.363948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerDied","Data":"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"}
Jul 01 17:39:57.364546 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.364010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf" event={"ID":"77d9b883-a32f-4200-abd5-cae9fb7c7a2d","Type":"ContainerDied","Data":"202bd5a8682866eb9299748c7ed8d66d7fb7b00b86114c0cb6838751e73f6fb8"}
Jul 01 17:39:57.364546 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.364049    2582 scope.go:117] "RemoveContainer" containerID="c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"
Jul 01 17:39:57.372619 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.372601    2582 scope.go:117] "RemoveContainer" containerID="51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"
Jul 01 17:39:57.379949 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.379933    2582 scope.go:117] "RemoveContainer" containerID="95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"
Jul 01 17:39:57.385710 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.385687    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:39:57.387783 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.387767    2582 scope.go:117] "RemoveContainer" containerID="c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"
Jul 01 17:39:57.388047 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:39:57.388029    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb\": container with ID starting with c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb not found: ID does not exist" containerID="c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"
Jul 01 17:39:57.388101 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388055    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb"} err="failed to get container status \"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb\": rpc error: code = NotFound desc = could not find container \"c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb\": container with ID starting with c6ff1c114cbe07a440214990610513d9c33cd2ce9a4996cc496bdd6036630dfb not found: ID does not exist"
Jul 01 17:39:57.388101 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388074    2582 scope.go:117] "RemoveContainer" containerID="51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"
Jul 01 17:39:57.388275 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388259    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-wswcf"]
Jul 01 17:39:57.388322 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:39:57.388272    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19\": container with ID starting with 51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19 not found: ID does not exist" containerID="51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"
Jul 01 17:39:57.388322 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388286    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19"} err="failed to get container status \"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19\": rpc error: code = NotFound desc = could not find container \"51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19\": container with ID starting with 51e6125c298be4b4db5aa46ae028a573a8ef087873f3b6ff54b91776e4e92e19 not found: ID does not exist"
Jul 01 17:39:57.388322 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388308    2582 scope.go:117] "RemoveContainer" containerID="95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"
Jul 01 17:39:57.388528 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:39:57.388511    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35\": container with ID starting with 95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35 not found: ID does not exist" containerID="95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"
Jul 01 17:39:57.388589 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:57.388547    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35"} err="failed to get container status \"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35\": rpc error: code = NotFound desc = could not find container \"95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35\": container with ID starting with 95707b5ea33c15d6ed34375291acda5b88adda77e52a9bbd37aee1dd13078d35 not found: ID does not exist"
Jul 01 17:39:58.660519 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:39:58.660488    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" path="/var/lib/kubelet/pods/77d9b883-a32f-4200-abd5-cae9fb7c7a2d/volumes"
Jul 01 17:40:01.262246 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262205    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262552    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kube-rbac-proxy"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262564    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kube-rbac-proxy"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262588    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="storage-initializer"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262594    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="storage-initializer"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262603    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kserve-container"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262609    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kserve-container"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262655    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kserve-container"
Jul 01 17:40:01.262697 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.262665    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="77d9b883-a32f-4200-abd5-cae9fb7c7a2d" containerName="kube-rbac-proxy"
Jul 01 17:40:01.267738 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.267720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.270838 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270815    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:40:01.270961 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-kube-rbac-proxy-sar-config\""
Jul 01 17:40:01.271033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270822    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:40:01.271033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-predictor-serving-cert\""
Jul 01 17:40:01.271033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270858    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:40:01.271033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.270883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:40:01.271974 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.271954    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l8gxp\""
Jul 01 17:40:01.277138 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.277107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:40:01.348680 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.348645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7kl9\" (UniqueName: \"kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.348853 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.348690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.348853 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.348710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.348853 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.348731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.348853 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.348801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450086 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7kl9\" (UniqueName: \"kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450276 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450566 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450859 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450839    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.450942 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.450878    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.452633 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.452616    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.458501 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.458478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7kl9\" (UniqueName: \"kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.577567 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.577484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:01.706098 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:01.706061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:40:01.708385 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:40:01.708357    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184980ab_79b8_46eb_90c0_7ebccc6b7c5d.slice/crio-38ede5688ac7e89b5bd9ea07ae11790adb7f8f67a4f5e164f5d2ad3cd4b38758 WatchSource:0}: Error finding container 38ede5688ac7e89b5bd9ea07ae11790adb7f8f67a4f5e164f5d2ad3cd4b38758: Status 404 returned error can't find the container with id 38ede5688ac7e89b5bd9ea07ae11790adb7f8f67a4f5e164f5d2ad3cd4b38758
Jul 01 17:40:02.387437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:02.387393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerStarted","Data":"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"}
Jul 01 17:40:02.387812 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:02.387495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerStarted","Data":"38ede5688ac7e89b5bd9ea07ae11790adb7f8f67a4f5e164f5d2ad3cd4b38758"}
Jul 01 17:40:31.510954 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:31.510924    2582 generic.go:356] "Generic (PLEG): container finished" podID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerID="ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7" exitCode=0
Jul 01 17:40:31.511308 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:31.510984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerDied","Data":"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"}
Jul 01 17:40:32.517126 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:32.517095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerStarted","Data":"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"}
Jul 01 17:40:32.517574 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:32.517156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerStarted","Data":"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"}
Jul 01 17:40:32.517574 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:32.517342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:32.537187 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:32.537144    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" podStartSLOduration=2.240845617 podStartE2EDuration="31.537132027s" totalImagesPullingTime="0s" totalInitContainerRuntime="29.29628641s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:32.535945058 +0000 UTC m=+1454.309531864" watchObservedRunningTime="2026-07-01 17:40:32.537132027 +0000 UTC m=+1454.310718830"
Jul 01 17:40:33.522404 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:33.522374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:40:39.533864 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:40:39.533836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:41:18.733475 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:41:18.733435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:41:18.736174 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:41:18.736152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:42:04.658760 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:04.658726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:42:11.419689 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:11.419655    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:42:11.420311 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:11.419869    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kserve-container" containerID="cri-o://6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f" gracePeriod=30
Jul 01 17:42:11.420311 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:11.419939    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kube-rbac-proxy" containerID="cri-o://9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab" gracePeriod=30
Jul 01 17:42:11.926624 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:11.926591    2582 generic.go:356] "Generic (PLEG): container finished" podID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerID="9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab" exitCode=2
Jul 01 17:42:11.926791 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:11.926666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerDied","Data":"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"}
Jul 01 17:42:12.166071 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.166049    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:42:12.328694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.328652    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config\") pod \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") "
Jul 01 17:42:12.328846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.328724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location\") pod \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") "
Jul 01 17:42:12.328846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.328778    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls\") pod \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") "
Jul 01 17:42:12.328846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.328818    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7kl9\" (UniqueName: \"kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9\") pod \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") "
Jul 01 17:42:12.329036 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.328849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert\") pod \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\" (UID: \"184980ab-79b8-46eb-90c0-7ebccc6b7c5d\") "
Jul 01 17:42:12.329036 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.329020    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "184980ab-79b8-46eb-90c0-7ebccc6b7c5d" (UID: "184980ab-79b8-46eb-90c0-7ebccc6b7c5d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:42:12.329176 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.329159    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:12.329267 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.329233    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "184980ab-79b8-46eb-90c0-7ebccc6b7c5d" (UID: "184980ab-79b8-46eb-90c0-7ebccc6b7c5d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:42:12.330951 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.330929    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9" (OuterVolumeSpecName: "kube-api-access-n7kl9") pod "184980ab-79b8-46eb-90c0-7ebccc6b7c5d" (UID: "184980ab-79b8-46eb-90c0-7ebccc6b7c5d"). InnerVolumeSpecName "kube-api-access-n7kl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:42:12.331046 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.330958    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "184980ab-79b8-46eb-90c0-7ebccc6b7c5d" (UID: "184980ab-79b8-46eb-90c0-7ebccc6b7c5d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:42:12.333517 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.333491    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "184980ab-79b8-46eb-90c0-7ebccc6b7c5d" (UID: "184980ab-79b8-46eb-90c0-7ebccc6b7c5d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:42:12.430092 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.430057    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:12.430092 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.430084    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7kl9\" (UniqueName: \"kubernetes.io/projected/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kube-api-access-n7kl9\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:12.430437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.430099    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:12.430437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.430113    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/184980ab-79b8-46eb-90c0-7ebccc6b7c5d-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:12.933122 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.933046    2582 generic.go:356] "Generic (PLEG): container finished" podID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerID="6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f" exitCode=0
Jul 01 17:42:12.933122 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.933097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerDied","Data":"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"}
Jul 01 17:42:12.933122 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.933113    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"
Jul 01 17:42:12.933345 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.933145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx" event={"ID":"184980ab-79b8-46eb-90c0-7ebccc6b7c5d","Type":"ContainerDied","Data":"38ede5688ac7e89b5bd9ea07ae11790adb7f8f67a4f5e164f5d2ad3cd4b38758"}
Jul 01 17:42:12.933345 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.933170    2582 scope.go:117] "RemoveContainer" containerID="9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"
Jul 01 17:42:12.941188 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.941166    2582 scope.go:117] "RemoveContainer" containerID="6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"
Jul 01 17:42:12.948502 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.948482    2582 scope.go:117] "RemoveContainer" containerID="ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"
Jul 01 17:42:12.955144 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.955121    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:42:12.956536 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.956516    2582 scope.go:117] "RemoveContainer" containerID="9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"
Jul 01 17:42:12.956792 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:12.956765    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab\": container with ID starting with 9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab not found: ID does not exist" containerID="9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"
Jul 01 17:42:12.956846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.956800    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab"} err="failed to get container status \"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab\": rpc error: code = NotFound desc = could not find container \"9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab\": container with ID starting with 9844a7a200ede60734db912c958d2fa8420fc2ad59afe58d1bb97f503310ebab not found: ID does not exist"
Jul 01 17:42:12.956846 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.956818    2582 scope.go:117] "RemoveContainer" containerID="6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"
Jul 01 17:42:12.957048 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:12.957032    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f\": container with ID starting with 6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f not found: ID does not exist" containerID="6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"
Jul 01 17:42:12.957094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.957053    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f"} err="failed to get container status \"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f\": rpc error: code = NotFound desc = could not find container \"6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f\": container with ID starting with 6858675fffc79e63505ec52f9bc58a82c7e499fa8a6d37d6533e5ec54c6a8a6f not found: ID does not exist"
Jul 01 17:42:12.957094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.957068    2582 scope.go:117] "RemoveContainer" containerID="ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"
Jul 01 17:42:12.957261 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:12.957248    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7\": container with ID starting with ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7 not found: ID does not exist" containerID="ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"
Jul 01 17:42:12.957300 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.957264    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7"} err="failed to get container status \"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7\": rpc error: code = NotFound desc = could not find container \"ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7\": container with ID starting with ad2bbb66d24ce625d172518c4fe0deb74321aced48b59f6114d2f98b4b981aa7 not found: ID does not exist"
Jul 01 17:42:12.959634 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:12.959616    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-4z5dx"]
Jul 01 17:42:14.659265 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:14.659233    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" path="/var/lib/kubelet/pods/184980ab-79b8-46eb-90c0-7ebccc6b7c5d/volumes"
Jul 01 17:42:16.615626 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615594    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:16.615967 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615955    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kserve-container"
Jul 01 17:42:16.616019 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615969    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kserve-container"
Jul 01 17:42:16.616019 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615979    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="storage-initializer"
Jul 01 17:42:16.616019 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615985    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="storage-initializer"
Jul 01 17:42:16.616019 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.615994    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kube-rbac-proxy"
Jul 01 17:42:16.616019 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.616000    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kube-rbac-proxy"
Jul 01 17:42:16.616169 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.616061    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kube-rbac-proxy"
Jul 01 17:42:16.616169 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.616068    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="184980ab-79b8-46eb-90c0-7ebccc6b7c5d" containerName="kserve-container"
Jul 01 17:42:16.621167 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.621148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.623835 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.623808    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-predictor-serving-cert\""
Jul 01 17:42:16.623835 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.623832    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 17:42:16.624030 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.623890    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 17:42:16.624030 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.623898    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-l8gxp\""
Jul 01 17:42:16.624030 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.623890    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-kube-rbac-proxy-sar-config\""
Jul 01 17:42:16.624030 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.624022    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 17:42:16.625078 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.625058    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 17:42:16.627555 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.627534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:16.763042 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.763021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.763165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.763050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.763165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.763072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbv4q\" (UniqueName: \"kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.763165 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.763089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.763293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.763168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.863991 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.863965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.863994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbv4q\" (UniqueName: \"kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864094 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864313 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:16.864198    2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-serving-cert: secret "isvc-autogluon-ts-v1-predictor-serving-cert" not found
Jul 01 17:42:16.864313 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:16.864281    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls podName:978b1aae-499a-450c-80d3-50f2f4c786fd nodeName:}" failed. No retries permitted until 2026-07-01 17:42:17.364261297 +0000 UTC m=+1559.137848080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls") pod "isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd") : secret "isvc-autogluon-ts-v1-predictor-serving-cert" not found
Jul 01 17:42:16.864472 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864427    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864643 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864626    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.864678 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.864640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:16.872683 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:16.872631    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbv4q\" (UniqueName: \"kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:17.367876 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.367835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:17.370245 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.370210    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:17.533525 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.533485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:17.657720 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.657668    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:17.660010 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:42:17.659977    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978b1aae_499a_450c_80d3_50f2f4c786fd.slice/crio-403d2908b083fd927dbe9aa8ae0bf5b929e0aa9bda426037dbe1d0c73474ffed WatchSource:0}: Error finding container 403d2908b083fd927dbe9aa8ae0bf5b929e0aa9bda426037dbe1d0c73474ffed: Status 404 returned error can't find the container with id 403d2908b083fd927dbe9aa8ae0bf5b929e0aa9bda426037dbe1d0c73474ffed
Jul 01 17:42:17.956878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.956783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerStarted","Data":"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"}
Jul 01 17:42:17.956878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:17.956860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerStarted","Data":"403d2908b083fd927dbe9aa8ae0bf5b929e0aa9bda426037dbe1d0c73474ffed"}
Jul 01 17:42:26.999209 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:26.999175    2582 generic.go:356] "Generic (PLEG): container finished" podID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerID="2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39" exitCode=0
Jul 01 17:42:26.999601 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:26.999239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerDied","Data":"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"}
Jul 01 17:42:28.005504 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.005471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerStarted","Data":"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"}
Jul 01 17:42:28.005883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.005559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerStarted","Data":"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"}
Jul 01 17:42:28.005883 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.005849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:28.006033 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.006013    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:28.007339 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.007317    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 17:42:28.025506 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:28.025446    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podStartSLOduration=3.367143962 podStartE2EDuration="12.025433852s" totalImagesPullingTime="0s" totalInitContainerRuntime="8.65828989s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:42:28.023664964 +0000 UTC m=+1569.797251767" watchObservedRunningTime="2026-07-01 17:42:28.025433852 +0000 UTC m=+1569.799020655"
Jul 01 17:42:29.010758 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:29.010716    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 17:42:34.016249 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:34.016222    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:34.018521 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:34.016783    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 17:42:44.017590 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:44.017561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:46.826346 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:46.826317    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:46.826741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:46.826564    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container" containerID="cri-o://9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4" gracePeriod=30
Jul 01 17:42:46.826741 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:46.826580    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kube-rbac-proxy" containerID="cri-o://4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19" gracePeriod=30
Jul 01 17:42:47.091687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.091597    2582 generic.go:356] "Generic (PLEG): container finished" podID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerID="4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19" exitCode=2
Jul 01 17:42:47.091687 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.091646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerDied","Data":"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"}
Jul 01 17:42:47.573005 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.572983    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.710240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbv4q\" (UniqueName: \"kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q\") pod \"978b1aae-499a-450c-80d3-50f2f4c786fd\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") "
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.710318    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location\") pod \"978b1aae-499a-450c-80d3-50f2f4c786fd\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") "
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.710352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") pod \"978b1aae-499a-450c-80d3-50f2f4c786fd\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") "
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.710419    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert\") pod \"978b1aae-499a-450c-80d3-50f2f4c786fd\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") "
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.710484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config\") pod \"978b1aae-499a-450c-80d3-50f2f4c786fd\" (UID: \"978b1aae-499a-450c-80d3-50f2f4c786fd\") "
Jul 01 17:42:47.715832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.711149    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "978b1aae-499a-450c-80d3-50f2f4c786fd" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:42:47.716397 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.716370    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "978b1aae-499a-450c-80d3-50f2f4c786fd" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 17:42:47.716562 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.716533    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q" (OuterVolumeSpecName: "kube-api-access-fbv4q") pod "978b1aae-499a-450c-80d3-50f2f4c786fd" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd"). InnerVolumeSpecName "kube-api-access-fbv4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:42:47.716901 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.716883    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "978b1aae-499a-450c-80d3-50f2f4c786fd" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:42:47.717623 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.717601    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "978b1aae-499a-450c-80d3-50f2f4c786fd" (UID: "978b1aae-499a-450c-80d3-50f2f4c786fd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 17:42:47.812161 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.812136    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbv4q\" (UniqueName: \"kubernetes.io/projected/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-api-access-fbv4q\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:47.812161 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.812159    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978b1aae-499a-450c-80d3-50f2f4c786fd-kserve-provision-location\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:47.812296 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.812172    2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/978b1aae-499a-450c-80d3-50f2f4c786fd-proxy-tls\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:47.812296 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.812184    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-cabundle-cert\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:47.812296 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:47.812195    2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/978b1aae-499a-450c-80d3-50f2f4c786fd-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:42:48.097590 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.097562    2582 generic.go:356] "Generic (PLEG): container finished" podID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerID="9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4" exitCode=0
Jul 01 17:42:48.097962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.097608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerDied","Data":"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"}
Jul 01 17:42:48.097962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.097628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"
Jul 01 17:42:48.097962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.097678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms" event={"ID":"978b1aae-499a-450c-80d3-50f2f4c786fd","Type":"ContainerDied","Data":"403d2908b083fd927dbe9aa8ae0bf5b929e0aa9bda426037dbe1d0c73474ffed"}
Jul 01 17:42:48.097962 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.097703    2582 scope.go:117] "RemoveContainer" containerID="4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"
Jul 01 17:42:48.105868 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.105850    2582 scope.go:117] "RemoveContainer" containerID="9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"
Jul 01 17:42:48.113124 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.113105    2582 scope.go:117] "RemoveContainer" containerID="2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"
Jul 01 17:42:48.120768 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.120745    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:48.121048 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121029    2582 scope.go:117] "RemoveContainer" containerID="4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"
Jul 01 17:42:48.121271 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:48.121255    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19\": container with ID starting with 4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19 not found: ID does not exist" containerID="4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"
Jul 01 17:42:48.121329 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121280    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19"} err="failed to get container status \"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19\": rpc error: code = NotFound desc = could not find container \"4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19\": container with ID starting with 4ab64446cd29cd61f4aeb314e950697a4fd3a5f5756e6e99a764dae5c506cc19 not found: ID does not exist"
Jul 01 17:42:48.121329 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121297    2582 scope.go:117] "RemoveContainer" containerID="9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"
Jul 01 17:42:48.121536 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:48.121516    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4\": container with ID starting with 9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4 not found: ID does not exist" containerID="9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"
Jul 01 17:42:48.121613 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121547    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4"} err="failed to get container status \"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4\": rpc error: code = NotFound desc = could not find container \"9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4\": container with ID starting with 9edc9b4da0c6fe7ce110885406150806e0b561d1eb5b8d126c63147aa63df9e4 not found: ID does not exist"
Jul 01 17:42:48.121613 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121569    2582 scope.go:117] "RemoveContainer" containerID="2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"
Jul 01 17:42:48.121908 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:42:48.121887    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39\": container with ID starting with 2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39 not found: ID does not exist" containerID="2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"
Jul 01 17:42:48.122000 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.121916    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39"} err="failed to get container status \"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39\": rpc error: code = NotFound desc = could not find container \"2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39\": container with ID starting with 2b536c748a13d9ef153cb40fb0f53bfdf8226117dc8855169d58b63c4f05ac39 not found: ID does not exist"
Jul 01 17:42:48.123965 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.123947    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-gn2ms"]
Jul 01 17:42:48.659832 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:48.659804    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" path="/var/lib/kubelet/pods/978b1aae-499a-450c-80d3-50f2f4c786fd/volumes"
Jul 01 17:42:53.100794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.100763    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh8xh/must-gather-thdvn"]
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101071    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kube-rbac-proxy"
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101081    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kube-rbac-proxy"
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101090    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="storage-initializer"
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101096    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="storage-initializer"
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101115    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container"
Jul 01 17:42:53.101137 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101120    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container"
Jul 01 17:42:53.101317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101174    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kserve-container"
Jul 01 17:42:53.101317 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.101183    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="978b1aae-499a-450c-80d3-50f2f4c786fd" containerName="kube-rbac-proxy"
Jul 01 17:42:53.105639 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.105620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.108203 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.108187    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh8xh\"/\"kube-root-ca.crt\""
Jul 01 17:42:53.108437 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.108421    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh8xh\"/\"openshift-service-ca.crt\""
Jul 01 17:42:53.109293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.109273    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jh8xh\"/\"default-dockercfg-znp28\""
Jul 01 17:42:53.112917 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.112894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh8xh/must-gather-thdvn"]
Jul 01 17:42:53.248293 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.248265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.248472 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.248322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nksm7\" (UniqueName: \"kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.349343 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.349320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.349520 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.349391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nksm7\" (UniqueName: \"kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.349647 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.349627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.358892 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.358841    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nksm7\" (UniqueName: \"kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7\") pod \"must-gather-thdvn\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") " pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.423835 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.423803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:42:53.545414 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.545385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh8xh/must-gather-thdvn"]
Jul 01 17:42:53.548345 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:42:53.548315    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb64a9e75_1fe1_4495_8471_22e3cdba4ca7.slice/crio-d9f1f645a6cbe66815246176c306a6ab0669a631ac5c63dd20c73ba9fefe8f91 WatchSource:0}: Error finding container d9f1f645a6cbe66815246176c306a6ab0669a631ac5c63dd20c73ba9fefe8f91: Status 404 returned error can't find the container with id d9f1f645a6cbe66815246176c306a6ab0669a631ac5c63dd20c73ba9fefe8f91
Jul 01 17:42:53.550722 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:53.550707    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 17:42:54.126517 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:42:54.126481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh8xh/must-gather-thdvn" event={"ID":"b64a9e75-1fe1-4495-8471-22e3cdba4ca7","Type":"ContainerStarted","Data":"d9f1f645a6cbe66815246176c306a6ab0669a631ac5c63dd20c73ba9fefe8f91"}
Jul 01 17:43:01.161974 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:01.161943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh8xh/must-gather-thdvn" event={"ID":"b64a9e75-1fe1-4495-8471-22e3cdba4ca7","Type":"ContainerStarted","Data":"c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a"}
Jul 01 17:43:01.162340 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:01.161986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh8xh/must-gather-thdvn" event={"ID":"b64a9e75-1fe1-4495-8471-22e3cdba4ca7","Type":"ContainerStarted","Data":"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"}
Jul 01 17:43:01.180232 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:01.180180    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh8xh/must-gather-thdvn" podStartSLOduration=1.683230365 podStartE2EDuration="8.180161727s" totalImagesPullingTime="6.496931362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:43:01.176649852 +0000 UTC m=+1602.950236647" watchObservedRunningTime="2026-07-01 17:43:01.180161727 +0000 UTC m=+1602.953748532"
Jul 01 17:43:20.251892 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:20.251857    2582 generic.go:356] "Generic (PLEG): container finished" podID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerID="0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254" exitCode=0
Jul 01 17:43:20.252292 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:20.251937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh8xh/must-gather-thdvn" event={"ID":"b64a9e75-1fe1-4495-8471-22e3cdba4ca7","Type":"ContainerDied","Data":"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"}
Jul 01 17:43:20.252292 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:20.252207    2582 scope.go:117] "RemoveContainer" containerID="0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"
Jul 01 17:43:21.038070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.038041    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jh8xh_must-gather-thdvn_b64a9e75-1fe1-4495-8471-22e3cdba4ca7/gather/0.log"
Jul 01 17:43:21.624878 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.624846    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k4l4g/must-gather-htvtj"]
Jul 01 17:43:21.627278 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.627262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.630089 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.630068    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k4l4g\"/\"openshift-service-ca.crt\""
Jul 01 17:43:21.630201 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.630116    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k4l4g\"/\"kube-root-ca.crt\""
Jul 01 17:43:21.631412 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.631396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k4l4g\"/\"default-dockercfg-55pcp\""
Jul 01 17:43:21.637028 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.637011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4l4g/must-gather-htvtj"]
Jul 01 17:43:21.710096 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.710058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3460f96-c321-4118-90e4-a422fd771373-must-gather-output\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.710288 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.710115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb2fx\" (UniqueName: \"kubernetes.io/projected/c3460f96-c321-4118-90e4-a422fd771373-kube-api-access-nb2fx\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.811345 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.811316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2fx\" (UniqueName: \"kubernetes.io/projected/c3460f96-c321-4118-90e4-a422fd771373-kube-api-access-nb2fx\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.811436 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.811415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3460f96-c321-4118-90e4-a422fd771373-must-gather-output\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.811771 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.811752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3460f96-c321-4118-90e4-a422fd771373-must-gather-output\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.820264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.820237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb2fx\" (UniqueName: \"kubernetes.io/projected/c3460f96-c321-4118-90e4-a422fd771373-kube-api-access-nb2fx\") pod \"must-gather-htvtj\" (UID: \"c3460f96-c321-4118-90e4-a422fd771373\") " pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:21.937044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:21.936991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4l4g/must-gather-htvtj"
Jul 01 17:43:22.068070 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:22.068047    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4l4g/must-gather-htvtj"]
Jul 01 17:43:22.069812 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:43:22.069769    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3460f96_c321_4118_90e4_a422fd771373.slice/crio-6819bd074a8e2335cd4f5bd253406a85c33c26813ef249e71ba13a1aabd187aa WatchSource:0}: Error finding container 6819bd074a8e2335cd4f5bd253406a85c33c26813ef249e71ba13a1aabd187aa: Status 404 returned error can't find the container with id 6819bd074a8e2335cd4f5bd253406a85c33c26813ef249e71ba13a1aabd187aa
Jul 01 17:43:22.261642 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:22.261613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4l4g/must-gather-htvtj" event={"ID":"c3460f96-c321-4118-90e4-a422fd771373","Type":"ContainerStarted","Data":"6819bd074a8e2335cd4f5bd253406a85c33c26813ef249e71ba13a1aabd187aa"}
Jul 01 17:43:24.274501 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:24.274436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4l4g/must-gather-htvtj" event={"ID":"c3460f96-c321-4118-90e4-a422fd771373","Type":"ContainerStarted","Data":"dfb1e4336b613d77e95216cea51abb1fb392c3c484ae5d249c4d6fdd7d376100"}
Jul 01 17:43:24.274976 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:24.274514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4l4g/must-gather-htvtj" event={"ID":"c3460f96-c321-4118-90e4-a422fd771373","Type":"ContainerStarted","Data":"ef74fd749beb812bd9c3ce7af6ffcf70341a737e557100cf1a6c7c66554be00c"}
Jul 01 17:43:24.291091 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:24.291042    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k4l4g/must-gather-htvtj" podStartSLOduration=2.14406292 podStartE2EDuration="3.291028878s" totalImagesPullingTime="1.146965958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:43:24.289587486 +0000 UTC m=+1626.063174289" watchObservedRunningTime="2026-07-01 17:43:24.291028878 +0000 UTC m=+1626.064615682"
Jul 01 17:43:24.786595 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:24.786564    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4hmvb_b1e5ec97-77e0-44e2-b78c-8e6d5a4265cd/global-pull-secret-syncer/0.log"
Jul 01 17:43:24.996433 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:24.996403    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hrlxp_2bbb4bf0-4114-46a0-a1d6-cdff0660477e/konnectivity-agent/0.log"
Jul 01 17:43:25.111081 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:25.111002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-81.ec2.internal_1c6f01bf881842f56beb7f6d6350515a/haproxy/0.log"
Jul 01 17:43:26.436794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.436755    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jh8xh/must-gather-thdvn"]
Jul 01 17:43:26.437284 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.437002    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-jh8xh/must-gather-thdvn" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="copy" containerID="cri-o://c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a" gracePeriod=2
Jul 01 17:43:26.439594 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:43:26.439548    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-thdvn\" is forbidden: User \"system:node:ip-10-0-142-81.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jh8xh\": no relationship found between node 'ip-10-0-142-81.ec2.internal' and this object" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:43:26.442745 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.442713    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jh8xh/must-gather-thdvn"]
Jul 01 17:43:26.817473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.815600    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jh8xh_must-gather-thdvn_b64a9e75-1fe1-4495-8471-22e3cdba4ca7/copy/0.log"
Jul 01 17:43:26.823473 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.818403    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:43:26.860415 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.859241    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output\") pod \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") "
Jul 01 17:43:26.860415 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.859293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nksm7\" (UniqueName: \"kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7\") pod \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\" (UID: \"b64a9e75-1fe1-4495-8471-22e3cdba4ca7\") "
Jul 01 17:43:26.863530 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.861049    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b64a9e75-1fe1-4495-8471-22e3cdba4ca7" (UID: "b64a9e75-1fe1-4495-8471-22e3cdba4ca7"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 17:43:26.866111 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.866070    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7" (OuterVolumeSpecName: "kube-api-access-nksm7") pod "b64a9e75-1fe1-4495-8471-22e3cdba4ca7" (UID: "b64a9e75-1fe1-4495-8471-22e3cdba4ca7"). InnerVolumeSpecName "kube-api-access-nksm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 17:43:26.961107 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.961067    2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-must-gather-output\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:43:26.961336 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:26.961318    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nksm7\" (UniqueName: \"kubernetes.io/projected/b64a9e75-1fe1-4495-8471-22e3cdba4ca7-kube-api-access-nksm7\") on node \"ip-10-0-142-81.ec2.internal\" DevicePath \"\""
Jul 01 17:43:27.296978 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.296946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jh8xh_must-gather-thdvn_b64a9e75-1fe1-4495-8471-22e3cdba4ca7/copy/0.log"
Jul 01 17:43:27.297412 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.297380    2582 generic.go:356] "Generic (PLEG): container finished" podID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerID="c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a" exitCode=143
Jul 01 17:43:27.297551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.297521    2582 scope.go:117] "RemoveContainer" containerID="c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a"
Jul 01 17:43:27.297715 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.297696    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh8xh/must-gather-thdvn"
Jul 01 17:43:27.312336 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.312233    2582 scope.go:117] "RemoveContainer" containerID="0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"
Jul 01 17:43:27.335162 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.335132    2582 scope.go:117] "RemoveContainer" containerID="c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a"
Jul 01 17:43:27.335939 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:43:27.335761    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a\": container with ID starting with c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a not found: ID does not exist" containerID="c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a"
Jul 01 17:43:27.335939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.335800    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a"} err="failed to get container status \"c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a\": rpc error: code = NotFound desc = could not find container \"c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a\": container with ID starting with c4e905a2ea762ebaeee9352172ac5cab7e34720a1bd9626b88681ba55e74f72a not found: ID does not exist"
Jul 01 17:43:27.335939 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.335824    2582 scope.go:117] "RemoveContainer" containerID="0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"
Jul 01 17:43:27.336551 ip-10-0-142-81 kubenswrapper[2582]: E0701 17:43:27.336473    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254\": container with ID starting with 0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254 not found: ID does not exist" containerID="0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"
Jul 01 17:43:27.336551 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:27.336507    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254"} err="failed to get container status \"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254\": rpc error: code = NotFound desc = could not find container \"0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254\": container with ID starting with 0fa876127772815c6ad32be1567d9e2678a58e2493354ded4ca43006b2ce7254 not found: ID does not exist"
Jul 01 17:43:28.568328 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.568296    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/alertmanager/0.log"
Jul 01 17:43:28.641277 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.641239    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/config-reloader/0.log"
Jul 01 17:43:28.666288 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.666251    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" path="/var/lib/kubelet/pods/b64a9e75-1fe1-4495-8471-22e3cdba4ca7/volumes"
Jul 01 17:43:28.678084 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.678047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/kube-rbac-proxy-web/0.log"
Jul 01 17:43:28.713757 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.713727    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/kube-rbac-proxy/0.log"
Jul 01 17:43:28.743091 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.743058    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/kube-rbac-proxy-metric/0.log"
Jul 01 17:43:28.775088 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.774690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/prom-label-proxy/0.log"
Jul 01 17:43:28.820208 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.820108    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f189b054-9a9f-4700-a2b5-4781c8d4ccf8/init-config-reloader/0.log"
Jul 01 17:43:28.902617 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.902580    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-ngsbg_0731604d-3819-4ddc-ad69-81792e8b610a/kube-state-metrics/0.log"
Jul 01 17:43:28.931124 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.931075    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-ngsbg_0731604d-3819-4ddc-ad69-81792e8b610a/kube-rbac-proxy-main/0.log"
Jul 01 17:43:28.977336 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:28.977289    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-ngsbg_0731604d-3819-4ddc-ad69-81792e8b610a/kube-rbac-proxy-self/0.log"
Jul 01 17:43:29.026399 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.026366    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-644ccfb987-9gsvt_463f249a-2de3-488f-9ec4-f4e2e84e0c7d/metrics-server/0.log"
Jul 01 17:43:29.069536 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.069505    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-nt5qz_423ab4ab-5f47-4148-a25a-80530236f7ee/monitoring-plugin/0.log"
Jul 01 17:43:29.247980 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.247951    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrdw9_a3ef1740-466f-4fad-8cdd-8c056561feee/node-exporter/0.log"
Jul 01 17:43:29.276776 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.276750    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrdw9_a3ef1740-466f-4fad-8cdd-8c056561feee/kube-rbac-proxy/0.log"
Jul 01 17:43:29.302788 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.302762    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vrdw9_a3ef1740-466f-4fad-8cdd-8c056561feee/init-textfile/0.log"
Jul 01 17:43:29.427797 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.427711    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zvdrn_f1de28c2-ec09-4e08-b82f-3ce78ff212dd/kube-rbac-proxy-main/0.log"
Jul 01 17:43:29.457376 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.457324    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zvdrn_f1de28c2-ec09-4e08-b82f-3ce78ff212dd/kube-rbac-proxy-self/0.log"
Jul 01 17:43:29.484756 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.484731    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-zvdrn_f1de28c2-ec09-4e08-b82f-3ce78ff212dd/openshift-state-metrics/0.log"
Jul 01 17:43:29.532341 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.532286    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/prometheus/0.log"
Jul 01 17:43:29.559112 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.559081    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/config-reloader/0.log"
Jul 01 17:43:29.586790 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.586759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/thanos-sidecar/0.log"
Jul 01 17:43:29.617663 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.617633    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/kube-rbac-proxy-web/0.log"
Jul 01 17:43:29.644740 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.644717    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/kube-rbac-proxy/0.log"
Jul 01 17:43:29.670622 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.670597    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/kube-rbac-proxy-thanos/0.log"
Jul 01 17:43:29.703471 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.702679    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66d48a23-6db2-4363-9194-3a562478edbb/init-config-reloader/0.log"
Jul 01 17:43:29.740851 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.740573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-w4j5p_8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead/prometheus-operator/0.log"
Jul 01 17:43:29.768219 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.768185    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-w4j5p_8cd14a3d-e24c-4a16-ac37-eed8cdbf1ead/kube-rbac-proxy/0.log"
Jul 01 17:43:29.798840 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.798814    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-xwllh_f71b7e81-aa0c-4c9d-b4c8-ac89aa9a30a0/prometheus-operator-admission-webhook/0.log"
Jul 01 17:43:29.834407 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.834345    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bdc5f5664-z75sb_6b5c21ba-7fd2-4e99-a556-7afb55428b96/telemeter-client/0.log"
Jul 01 17:43:29.861524 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.861445    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bdc5f5664-z75sb_6b5c21ba-7fd2-4e99-a556-7afb55428b96/reload/0.log"
Jul 01 17:43:29.889711 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.889677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bdc5f5664-z75sb_6b5c21ba-7fd2-4e99-a556-7afb55428b96/kube-rbac-proxy/0.log"
Jul 01 17:43:29.927363 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.927329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/thanos-query/0.log"
Jul 01 17:43:29.952409 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:29.952381    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/kube-rbac-proxy-web/0.log"
Jul 01 17:43:30.004688 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:30.004609    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/kube-rbac-proxy/0.log"
Jul 01 17:43:30.033694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:30.033658    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/prom-label-proxy/0.log"
Jul 01 17:43:30.061043 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:30.061009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/kube-rbac-proxy-rules/0.log"
Jul 01 17:43:30.089963 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:30.089930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bffbb96f5-gcsdx_74f3d02c-62b5-4f29-8d2c-ad5afe34ae0a/kube-rbac-proxy-metrics/0.log"
Jul 01 17:43:32.398121 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:32.398038    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-nvbdg_95e1f23f-3ae7-4588-a9b0-0af731271312/download-server/0.log"
Jul 01 17:43:33.518820 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.518788    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"]
Jul 01 17:43:33.519812 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519783    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="gather"
Jul 01 17:43:33.519812 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519812    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="gather"
Jul 01 17:43:33.519968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519840    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="copy"
Jul 01 17:43:33.519968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519848    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="copy"
Jul 01 17:43:33.519968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519943    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="copy"
Jul 01 17:43:33.519968 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.519954    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64a9e75-1fe1-4495-8471-22e3cdba4ca7" containerName="gather"
Jul 01 17:43:33.529542 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.529513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.538044 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.537920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"]
Jul 01 17:43:33.634813 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.634768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-lib-modules\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.634993 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.634841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-proc\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.634993 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.634893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-sys\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.634993 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.634909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-podres\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.635156 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.635034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fn9\" (UniqueName: \"kubernetes.io/projected/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-kube-api-access-q8fn9\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736517 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fn9\" (UniqueName: \"kubernetes.io/projected/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-kube-api-access-q8fn9\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-lib-modules\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-proc\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-sys\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-podres\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736694 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-proc\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-podres\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736767    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-lib-modules\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.736898 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.736754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-sys\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.745082 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.745047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fn9\" (UniqueName: \"kubernetes.io/projected/63336b3d-c3f8-4b41-ae8b-fd582a66ff43-kube-api-access-q8fn9\") pod \"perf-node-gather-daemonset-kvqj4\" (UID: \"63336b3d-c3f8-4b41-ae8b-fd582a66ff43\") " pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.778409 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.778341    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-629b7_5895bd2d-db64-472e-b28b-bf60cea89667/dns/0.log"
Jul 01 17:43:33.801718 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.801690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-629b7_5895bd2d-db64-472e-b28b-bf60cea89667/kube-rbac-proxy/0.log"
Jul 01 17:43:33.845701 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.845664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:33.958417 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.958391    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsq92_c1fbf65a-b9e6-4082-838f-8e00a5395d63/dns-node-resolver/0.log"
Jul 01 17:43:33.991131 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:33.991096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"]
Jul 01 17:43:33.993727 ip-10-0-142-81 kubenswrapper[2582]: W0701 17:43:33.993702    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63336b3d_c3f8_4b41_ae8b_fd582a66ff43.slice/crio-c6b5553122d419aea376393067f96eac76086b37acf7ff2ee9165ec26e544875 WatchSource:0}: Error finding container c6b5553122d419aea376393067f96eac76086b37acf7ff2ee9165ec26e544875: Status 404 returned error can't find the container with id c6b5553122d419aea376393067f96eac76086b37acf7ff2ee9165ec26e544875
Jul 01 17:43:34.342675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:34.342578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4" event={"ID":"63336b3d-c3f8-4b41-ae8b-fd582a66ff43","Type":"ContainerStarted","Data":"4d39ac79dd0de4d68ce213dcc09e029069257214c60f75c26630884f77bad507"}
Jul 01 17:43:34.342675 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:34.342651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4" event={"ID":"63336b3d-c3f8-4b41-ae8b-fd582a66ff43","Type":"ContainerStarted","Data":"c6b5553122d419aea376393067f96eac76086b37acf7ff2ee9165ec26e544875"}
Jul 01 17:43:34.343360 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:34.343335    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:34.361996 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:34.361942    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4" podStartSLOduration=1.361923949 podStartE2EDuration="1.361923949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:43:34.358877487 +0000 UTC m=+1636.132464304" watchObservedRunningTime="2026-07-01 17:43:34.361923949 +0000 UTC m=+1636.135510754"
Jul 01 17:43:34.461142 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:34.461111    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b44wl_c215cf4c-2590-4bb6-828a-935772c1c8fc/node-ca/0.log"
Jul 01 17:43:35.719827 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:35.719793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hthck_d841581c-27b7-4b3b-b771-e887a23de0aa/serve-healthcheck-canary/0.log"
Jul 01 17:43:36.223123 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:36.223093    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7k2s_a8718870-34e5-469c-91dd-4b22e61820ef/kube-rbac-proxy/0.log"
Jul 01 17:43:36.245383 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:36.245349    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7k2s_a8718870-34e5-469c-91dd-4b22e61820ef/exporter/0.log"
Jul 01 17:43:36.268788 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:36.268762    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7k2s_a8718870-34e5-469c-91dd-4b22e61820ef/extractor/0.log"
Jul 01 17:43:38.445672 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.445647    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-z8xtt_33e8c360-d4ae-47ca-b372-e2056ea1e539/s3-init/0.log"
Jul 01 17:43:38.465045 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.465017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-z8xtt_33e8c360-d4ae-47ca-b372-e2056ea1e539/download-hf-model/0.log"
Jul 01 17:43:38.495736 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.495708    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-lkmrg_700fa123-e0ff-4d1e-962b-1934c0929a12/s3-tls-init-custom/0.log"
Jul 01 17:43:38.513676 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.513652    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-lkmrg_700fa123-e0ff-4d1e-962b-1934c0929a12/download-hf-model/0.log"
Jul 01 17:43:38.543654 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.543625    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-n2sf2_dde9bc90-3f35-4bcd-ba87-d11832de1464/s3-tls-init-serving/0.log"
Jul 01 17:43:38.577695 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.577669    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-n2sf2_dde9bc90-3f35-4bcd-ba87-d11832de1464/download-hf-model/0.log"
Jul 01 17:43:38.660038 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:38.660002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-ff5jz_fad3abdd-b8a1-4618-836e-dae54546d5e4/seaweedfs-tls-serving/0.log"
Jul 01 17:43:41.362908 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:41.362881    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k4l4g/perf-node-gather-daemonset-kvqj4"
Jul 01 17:43:44.394658 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.394630    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/kube-multus-additional-cni-plugins/0.log"
Jul 01 17:43:44.428794 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.428753    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/egress-router-binary-copy/0.log"
Jul 01 17:43:44.456831 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.456801    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/cni-plugins/0.log"
Jul 01 17:43:44.499329 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.499298    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/bond-cni-plugin/0.log"
Jul 01 17:43:44.541153 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.541123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/routeoverride-cni/0.log"
Jul 01 17:43:44.578264 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.578232    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/whereabouts-cni-bincopy/0.log"
Jul 01 17:43:44.612660 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.612633    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l6tnd_12c33db9-4a66-46c6-88f3-b5b0b6ebfd72/whereabouts-cni/0.log"
Jul 01 17:43:44.659003 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.658909    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g5r8q_04af0054-c16b-4850-999a-a7dcdd8ad698/kube-multus/0.log"
Jul 01 17:43:44.789858 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.789829    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbptr_68690aef-39ff-420b-9b85-9ed5bab421c0/network-metrics-daemon/0.log"
Jul 01 17:43:44.820983 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:44.820959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbptr_68690aef-39ff-420b-9b85-9ed5bab421c0/kube-rbac-proxy/0.log"
Jul 01 17:43:45.954812 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:45.954780    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-controller/0.log"
Jul 01 17:43:45.991994 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:45.991968    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/1.log"
Jul 01 17:43:45.991994 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:45.991999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovn-acl-logging/0.log"
Jul 01 17:43:46.030601 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.030572    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/kube-rbac-proxy-node/0.log"
Jul 01 17:43:46.068812 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.068788    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/kube-rbac-proxy-ovn-metrics/0.log"
Jul 01 17:43:46.105315 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.105289    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/northd/0.log"
Jul 01 17:43:46.152301 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.152272    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/nbdb/0.log"
Jul 01 17:43:46.191027 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.190996    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/sbdb/0.log"
Jul 01 17:43:46.252527 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:46.252423    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cdscv_036bae6c-da67-4551-997c-f631db3be200/ovnkube-controller/0.log"
Jul 01 17:43:47.608428 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:47.608401    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wmjfv_768e2e4c-2b81-4578-8676-9292a482fd2b/network-check-target-container/0.log"
Jul 01 17:43:48.515935 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:48.515910    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4sm6q_a2e127d7-a966-42da-952f-dc130d74e0e3/iptables-alerter/0.log"
Jul 01 17:43:49.219866 ip-10-0-142-81 kubenswrapper[2582]: I0701 17:43:49.219839    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2bh4v_66077784-1078-4d8e-9338-c011780ed767/tuned/0.log"