Jul 28 01:23:55.967503 ip-10-0-138-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 01:23:55.967519 ip-10-0-138-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 01:23:55.967528 ip-10-0-138-153 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 01:23:55.967886 ip-10-0-138-153 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 01:24:05.978941 ip-10-0-138-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 28 01:24:05.978956 ip-10-0-138-153 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1c659135fb4e470aba8452bbac21a7af --
Jul 28 01:25:55.754271 ip-10-0-138-153 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 01:25:56.182918 ip-10-0-138-153 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:25:56.182918 ip-10-0-138-153 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 01:25:56.182918 ip-10-0-138-153 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:25:56.182918 ip-10-0-138-153 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 01:25:56.182918 ip-10-0-138-153 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:25:56.183924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.183836    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189265    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189285    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189288    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189292    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189296    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189299    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.189291 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189301    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189305    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189308    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189311    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189313    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189316    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189321    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189324    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189327    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189330    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189333    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189335    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189338    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189341    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189350    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189353    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189356    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189358    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189361    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189366    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.189525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189370    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189374    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189378    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189380    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189383    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189386    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189389    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189391    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189394    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189396    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189402    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189405    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189407    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189410    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189413    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189416    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189419    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189421    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189424    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.190170 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189427    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189429    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189432    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189435    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189439    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189442    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189444    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189447    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189455    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189458    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189460    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189463    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189466    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189468    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189471    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189473    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189478    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189481    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189483    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189486    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.190629 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189488    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189491    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189493    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189496    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189501    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189503    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189506    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189510    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189515    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189519    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189523    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189526    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189529    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189532    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189535    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189539    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189542    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189544    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189557    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189560    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.191111 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189562    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189609    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189616    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189619    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189621    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189641    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189781    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189786    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189790    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189793    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189795    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189798    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189801    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.189804    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190575    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190582    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190585    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190587    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190590    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190593    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.191607 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190596    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190598    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190601    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190603    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190606    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190609    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190611    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190615    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190619    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190622    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190625    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190628    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190630    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190633    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190637    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190640    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190642    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190645    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190648    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.192158 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190650    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190652    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190655    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190658    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190660    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190663    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190666    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190670    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190672    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190676    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190678    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190681    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190684    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190687    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190690    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190692    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190695    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190698    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190701    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.192618 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190704    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190706    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190708    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190711    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190713    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190716    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190718    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190721    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190723    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190726    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190728    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190731    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190734    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190736    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190739    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190742    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190744    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190747    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190751    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190754    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.193104 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190757    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190760    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190763    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190766    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190768    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190771    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190774    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190776    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190779    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190782    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190785    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190787    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190790    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190792    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190794    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190797    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190799    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190801    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190804    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190812    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.193588 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190815    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190817    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190819    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190822    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190824    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190827    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190829    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190831    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190834    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190836    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190839    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190841    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190844    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190846    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.190849    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191317    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191324    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191327    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191330    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191333    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.194077 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191335    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191338    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191340    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191343    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191345    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191348    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191350    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191353    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191355    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191358    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191360    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191368    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191371    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191374    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191376    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191378    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191381    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191383    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191386    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191388    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.194549 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191392    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191396    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191398    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191401    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191404    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191406    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191408    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191411    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191414    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191416    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191419    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191421    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191424    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191426    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191428    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191431    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191433    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191435    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191438    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191440    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.195062 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191443    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191445    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191447    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191450    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191457    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191460    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191462    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191465    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191467    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191471    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191474    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191477    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191480    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191483    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191486    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191488    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191490    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191494    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191497    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.195539 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191500    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191502    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191505    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191508    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191510    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191517    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191520    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191522    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191524    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191527    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191529    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191531    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191534    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191536    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191539    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191541    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191544    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191546    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191554    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191556    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.196040 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191559    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191561    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191563    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191566    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191568    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191571    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191573    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191576    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191578    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191580    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191583    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191585    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191588    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191594    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.191596    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191659    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191666    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191674    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191679    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191682    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191686    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 01:25:56.196543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191689    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191694    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191697    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191700    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191703    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191706    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191710    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191713    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191716    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191719    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191728    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191731    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191737    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191740    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191743    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191746    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191749    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191752    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191755    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191766    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191770    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191773    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191776    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191779    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 01:25:56.197096 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191784    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191787    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191790    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191793    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191796    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191817    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191820    2579 flags.go:64] FLAG: --enable-server="true"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191823    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191831    2579 flags.go:64] FLAG: --event-burst="100"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191834    2579 flags.go:64] FLAG: --event-qps="50"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191837    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191840    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191843    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191847    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191852    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191855    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191858    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191861    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191864    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191874    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191877    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191880    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191883    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191886    2579 flags.go:64] FLAG: --feature-gates=""
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191889    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 01:25:56.197642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191892    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191895    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191898    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191902    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191905    2579 flags.go:64] FLAG: --help="false"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191908    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191911    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191915    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191918    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191921    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191924    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191927    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191930    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191933    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191936    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191939    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191942    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191945    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191947    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191950    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191953    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191957    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191960    2579 flags.go:64] FLAG: --lock-file=""
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191980    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 01:25:56.198294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191984    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191987    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.191997    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192006    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192009    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192012    2579 flags.go:64] FLAG: --logging-format="text"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192015    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192018    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192022    2579 flags.go:64] FLAG: --manifest-url=""
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192024    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192029    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192032    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192036    2579 flags.go:64] FLAG: --max-pods="110"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192039    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192042    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192046    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192049    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192052    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192055    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192058    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192065    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192068    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192071    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 01:25:56.198961 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192074    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192077    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192083    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192086    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192089    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192092    2579 flags.go:64] FLAG: --port="10250"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192095    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192098    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07dac282e2d47d9d4"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192102    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192105    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192108    2579 flags.go:64] FLAG: --register-node="true"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192111    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192114    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192123    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192126    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192129    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192132    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192136    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192138    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192141    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192144    2579 flags.go:64] FLAG: --runonce="false"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192147    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192150    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192153    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192157    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 01:25:56.199535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192160    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192163    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192166    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192169    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192172    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192175    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192178    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192180    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192184    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192187    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192190    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192195    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192198    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192200    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192208    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192211    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192213    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192216    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192219    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192222    2579 flags.go:64] FLAG: --v="2"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192226    2579 flags.go:64] FLAG: --version="false"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192235    2579 flags.go:64] FLAG: --vmodule=""
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192239    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192242    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192363    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.200243 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192366    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192369    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192372    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192375    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192377    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192380    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192384    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192387    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192390    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192392    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192395    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192397    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192400    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192403    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192405    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192408    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192410    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192413    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192415    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192418    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.200850 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192420    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192424    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192427    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192430    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192432    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192436    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192439    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192442    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192445    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192454    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192457    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192460    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192462    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192465    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192467    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192470    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192472    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192474    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192479    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192481    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.201410 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192484    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192486    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192489    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192491    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192494    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192496    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192499    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192501    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192504    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192507    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192510    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192514    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192516    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192520    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192523    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192526    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192529    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192532    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192535    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192537    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.201874 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192540    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192542    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192551    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192554    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192556    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192559    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192562    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192564    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192567    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192569    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192573    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192576    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192578    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192580    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192583    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192585    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192588    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192590    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192593    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192595    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.202371 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192597    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192600    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192602    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192605    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192607    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192611    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192613    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192616    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192618    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192621    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192623    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192626    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192629    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192632    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192634    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192643    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192647    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.202888 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.192650    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.192655    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.199383    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.199397    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.199415    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.199421    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199480    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199486    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199489    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199493    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199496    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199498    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199501    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199504    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.203306 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199506    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199509    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199525    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199528    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199532    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199535    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199538    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199541    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199544    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199547    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199550    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199553    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199556    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199558    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199561    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199564    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199567    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199570    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199572    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199575    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.203640 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199577    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199580    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199583    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199586    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199588    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199590    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199593    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199596    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199598    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199601    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199603    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199605    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199608    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199610    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199613    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199615    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199617    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199620    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199622    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199625    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199627    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.204192 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199630    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199632    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199635    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199637    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199640    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199642    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199644    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199647    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199650    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199652    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199655    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199657    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199661    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199663    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199666    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199668    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199672    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199675    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199678    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.204696 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199680    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199683    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199685    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199687    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199690    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199692    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199695    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199697    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199700    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199702    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199705    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199707    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199710    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199712    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199715    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199718    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199722    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199724    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199727    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199729    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.205248 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199732    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199735    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199739    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199742    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199745    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199748    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199750    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199753    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199755    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199766    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199770    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.199775    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199905    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199909    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199912    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:25:56.205704 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199915    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199918    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199920    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199923    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199926    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199928    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199931    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199934    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199937    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199939    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199942    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199944    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199947    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199949    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199951    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199954    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199957    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199959    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199962    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199981    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199985    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:25:56.206081 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199988    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199990    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199993    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199995    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.199998    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200001    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200003    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200005    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200008    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200011    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200013    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200017    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200020    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200023    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200026    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200028    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200030    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200033    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200036    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:25:56.206567 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200039    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200041    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200044    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200047    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200051    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200054    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200057    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200060    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200062    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200065    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200068    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200071    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200073    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200080    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200083    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200086    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200088    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200090    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200093    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:25:56.207057 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200095    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200098    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200100    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200103    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200105    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200108    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200110    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200112    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200115    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200117    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200119    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200122    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200125    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200128    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200130    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200133    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200135    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200138    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200140    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:25:56.207500 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200143    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200145    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200148    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200150    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200153    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200155    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200158    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200161    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200165    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200168    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200170    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200173    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200175    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200177    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200180    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200182    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200185    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:25:56.208021 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:56.200187    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.200192    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.200297    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.202309    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.203993    2579 server.go:1019] "Starting client certificate rotation"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.204108    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.204142    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.206714    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:25:56.208453 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.208192    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:25:56.216008 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.215983    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 28 01:25:56.219265 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.219247    2579 log.go:25] "Validated CRI v1 image API"
Jul 28 01:25:56.220178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.220161    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 01:25:56.224000 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.223959    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f01e570a-68ed-4b21-a228-2b710cf6055e:/dev/nvme0n1p3 f688052d-8ee4-4b93-95b9-34854e098771:/dev/nvme0n1p4]
Jul 28 01:25:56.224072 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.223999    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 01:25:56.229119 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.229011    2579 manager.go:216] Machine: {Timestamp:2026-07-28 01:25:56.227574047 +0000 UTC m=+0.351674519 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3168246 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22dad4cf04a9295eeb3d5fdb316b9c SystemUUID:ec22dad4-cf04-a929-5eeb-3d5fdb316b9c BootID:1c659135-fb4e-470a-ba84-52bbac21a7af Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:85:8f:10:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:85:8f:10:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:d8:ef:f2:ea:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 01:25:56.229119 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.229113    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 01:25:56.229226 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.229190    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 01:25:56.232011 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.231978    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 01:25:56.232148 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.232013    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 01:25:56.233300 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.233289    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 01:25:56.233338 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.233302    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 01:25:56.233338 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.233310    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:25:56.233915 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.233900    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:25:56.234115 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.234105    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:25:56.235532 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.235522    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 01:25:56.238654 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238642    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:25:56.238772 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238763    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 01:25:56.238803 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238794    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 01:25:56.238830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238804    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 01:25:56.238830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238816    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 01:25:56.238884 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238836    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 28 01:25:56.238884 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.238849    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 01:25:56.239218 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.239206    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:25:56.239275 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.239224    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:25:56.242088 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.242072    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 01:25:56.243441 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.243427    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 01:25:56.243497 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.243456    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 01:25:56.244069 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244058    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 01:25:56.244109 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244075    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 01:25:56.244109 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244081    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 01:25:56.244109 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244087    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 01:25:56.244109 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244095    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 01:25:56.244109 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244101    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244177    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244184    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244190    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244196    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244209    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 01:25:56.244249 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.244217    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 01:25:56.245102 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.245092    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 01:25:56.245102 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.245102    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 01:25:56.247228 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.247203    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 01:25:56.247728 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.247702    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 01:25:56.247783 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.247767    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 01:25:56.248636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.248625    2579 server.go:1268] "Started kubelet"
Jul 28 01:25:56.248731 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.248695    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 01:25:56.248793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.248704    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 01:25:56.248793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.248781    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 01:25:56.249648 ip-10-0-138-153 systemd[1]: Started Kubernetes Kubelet.
Jul 28 01:25:56.250513 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.250485    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 01:25:56.251288 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.251277    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 01:25:56.255033 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.254041    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-153.ec2.internal.18c64fb88687b27e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-153.ec2.internal,UID:ip-10-0-138-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-153.ec2.internal,},FirstTimestamp:2026-07-28 01:25:56.248597118 +0000 UTC m=+0.372697591,LastTimestamp:2026-07-28 01:25:56.248597118 +0000 UTC m=+0.372697591,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-153.ec2.internal,}"
Jul 28 01:25:56.256344 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.256320    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p42dd"
Jul 28 01:25:56.258443 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.258424    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 01:25:56.258524 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.258447    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 01:25:56.258575 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.258542    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.259007 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.258985    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 01:25:56.259095 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259033    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 01:25:56.259095 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259037    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 01:25:56.259095 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259055    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 01:25:56.259242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259167    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 01:25:56.259242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259177    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 01:25:56.259242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259217    2579 factory.go:55] Registering systemd factory
Jul 28 01:25:56.259364 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259249    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 28 01:25:56.259460 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259447    2579 factory.go:153] Registering CRI-O factory
Jul 28 01:25:56.259511 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259466    2579 factory.go:223] Registration of the crio container factory successfully
Jul 28 01:25:56.259562 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259518    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 01:25:56.259562 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259547    2579 factory.go:103] Registering Raw factory
Jul 28 01:25:56.259562 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.259558    2579 manager.go:1196] Started watching for new ooms in manager
Jul 28 01:25:56.260209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.260193    2579 manager.go:349] Starting recovery of all containers
Jul 28 01:25:56.261221 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.261199    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 01:25:56.261429 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.261410    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 01:25:56.265084 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.265064    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p42dd"
Jul 28 01:25:56.271802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.271654    2579 manager.go:354] Recovery completed
Jul 28 01:25:56.276294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.276282    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.277925 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.277906    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.278015 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.277940    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.278015 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.277956    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.278485 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.278471    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 01:25:56.278485 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.278484    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 01:25:56.278577 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.278498    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:25:56.278577 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.278508    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.279303 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279287    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.279366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279328    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.279366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279348    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.279912 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.279839    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-153.ec2.internal.18c64fb888472e55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-153.ec2.internal,UID:ip-10-0-138-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-153.ec2.internal,},FirstTimestamp:2026-07-28 01:25:56.277923413 +0000 UTC m=+0.402023892,LastTimestamp:2026-07-28 01:25:56.277923413 +0000 UTC m=+0.402023892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-153.ec2.internal,}"
Jul 28 01:25:56.280026 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279934    2579 policy_none.go:49] "None policy: Start"
Jul 28 01:25:56.280026 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279947    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 01:25:56.280026 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.279957    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 01:25:56.281264 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.281252    2579 policy_none.go:47] "Start"
Jul 28 01:25:56.318535 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.318519    2579 manager.go:337] "Starting Device Plugin manager"
Jul 28 01:25:56.318619 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.318563    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 01:25:56.318619 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.318577    2579 server.go:87] "Starting device plugin registration server"
Jul 28 01:25:56.318841 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.318827    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 01:25:56.318911 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.318841    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 01:25:56.319013 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.318956    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 01:25:56.319070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.319053    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 01:25:56.319070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.319061    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 01:25:56.319532 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.319509    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 01:25:56.319621 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.319566    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.391424 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.391375    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 01:25:56.392829 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.392806    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 01:25:56.392932 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.392844    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 01:25:56.392932 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.392866    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 01:25:56.392932 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.392904    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 01:25:56.395098 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.395076    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:25:56.419873 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.419839    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.423696 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.423681    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.423790 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.423709    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.423790 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.423721    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.423790 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.423743    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.431423 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.431404    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.431472 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.431427    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-153.ec2.internal\": node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.445551 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.445500    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.493596 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.493566    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"]
Jul 28 01:25:56.493705 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.493643    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.494616 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.494600    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.494702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.494630    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.494702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.494642    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.495930 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.495918    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.496059 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.496099 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496071    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.496802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496779    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.496802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496805    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.496914 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496814    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.496914 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496784    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.496914 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496874    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.496914 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.496891    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.498101 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.498087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.498172 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.498111    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:25:56.500929 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.500914    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:25:56.501017 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.500953    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:25:56.501017 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.500981    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:25:56.526477 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.526451    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-153.ec2.internal\" not found" node="ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.530864 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.530848    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-153.ec2.internal\" not found" node="ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.545569 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.545546    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.561358 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.561333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.561440 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.561360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.561440 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.561378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d84437a22a1c0a2760cb8e46a57acd1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-153.ec2.internal\" (UID: \"0d84437a22a1c0a2760cb8e46a57acd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.645659 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.645626    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.662131 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d84437a22a1c0a2760cb8e46a57acd1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-153.ec2.internal\" (UID: \"0d84437a22a1c0a2760cb8e46a57acd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.662131 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d84437a22a1c0a2760cb8e46a57acd1-config\") pod \"kube-apiserver-proxy-ip-10-0-138-153.ec2.internal\" (UID: \"0d84437a22a1c0a2760cb8e46a57acd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.662227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.662227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.662227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.662320 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.662248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3c8aad278362c556bdbb4738c85bc81-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal\" (UID: \"f3c8aad278362c556bdbb4738c85bc81\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.746556 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.746479    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.829050 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.829018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.834668 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:56.834654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:56.846579 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.846556    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:56.948251 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:56.948202    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:57.050420 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.050297    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:57.150440 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.150394    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-153.ec2.internal\" not found"
Jul 28 01:25:57.203591 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.203555    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 01:25:57.204133 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.203707    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:25:57.220267 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.220234    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:25:57.239120 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.239096    2579 apiserver.go:52] "Watching apiserver"
Jul 28 01:25:57.247172 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.247152    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 01:25:57.247597 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.247576    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-kwjnd","openshift-multus/multus-qjndz","openshift-network-diagnostics/network-check-target-97l5d","openshift-network-operator/iptables-alerter-4lj4f","kube-system/konnectivity-agent-t2tkm","openshift-cluster-node-tuning-operator/tuned-qm2v8","openshift-multus/network-metrics-daemon-vcp24","openshift-ovn-kubernetes/ovnkube-node-zxgq6","kube-system/global-pull-secret-syncer-b6s48","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh","openshift-dns/node-resolver-vg9gk","openshift-image-registry/node-ca-qfwhr"]
Jul 28 01:25:57.249103 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.249079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.250215 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.250193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.251562 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251538    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 01:25:57.251691 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251596    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 01:25:57.251808 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251741    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zc97n\""
Jul 28 01:25:57.251808 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251794    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.251918 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 01:25:57.251918 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251835    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.251918 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.251611    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:57.252079 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.251941    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:25:57.252121 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.252102    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 01:25:57.252339 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.252318    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rbp2\""
Jul 28 01:25:57.252975 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.252954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.254321 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.254299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.255148 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.255123    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.256259 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.256232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-24n92\""
Jul 28 01:25:57.256605 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.256584    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 01:25:57.256752 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.256727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.257153 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.256781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.257587 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.257555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 01:25:57.258640 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.258621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b7vs8\""
Jul 28 01:25:57.258763 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.258652    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 01:25:57.259478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.258625    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 01:25:57.259478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.258931    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:57.259478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.259180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.259478 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.259267    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:25:57.259478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.259343    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.264014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.263917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6g28l\""
Jul 28 01:25:57.264123 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.264020    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.265016 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.264993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-kubernetes\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265135 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.265135 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-modprobe-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265135 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-sys\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-systemd\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265196    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-lib-modules\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-multus\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-systemd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-config\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-env-overrides\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-system-cni-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-netns\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-multus-certs\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-bin\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265631 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kml92\" (UniqueName: \"kubernetes.io/projected/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-kube-api-access-kml92\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-cnibin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-slash\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-systemd-units\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-var-lib-kubelet\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-tuned\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.265865 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-system-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-k8s-cni-cncf-io\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd6br\" (UniqueName: \"kubernetes.io/projected/cea807b4-1440-4ce0-9df4-b370eede16cc-kube-api-access-dd6br\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.265944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-host-slash\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-host\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-etc-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.266108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-log-socket\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-conf\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-script-lib\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43b5834e-ec09-4528-81ea-61434c05de0e-agent-certs\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-hostroot\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-daemon-config\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-tmp\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-bin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.266432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-cnibin\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-iptables-alerter-script\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43b5834e-ec09-4528-81ea-61434c05de0e-konnectivity-ca\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-run\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-kubelet\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrz4f\" (UniqueName: \"kubernetes.io/projected/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-kube-api-access-lrz4f\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-netd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-os-release\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-socket-dir-parent\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg57n\" (UniqueName: \"kubernetes.io/projected/a61aff14-3b2b-4ac8-8274-635e5535b752-kube-api-access-pg57n\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ddl\" (UniqueName: \"kubernetes.io/projected/bb74f5be-8c87-4755-aab0-219dad056c51-kube-api-access-z9ddl\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-var-lib-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdl65\" (UniqueName: \"kubernetes.io/projected/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-kube-api-access-hdl65\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-os-release\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-conf-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266826    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-etc-kubernetes\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.267357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-node-log\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.266824    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysconfig\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-kubelet\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.266974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z97hf\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-netns\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-ovn\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-cni-binary-copy\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267296    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267362    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267624    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267624    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.268379 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.267781    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 01:25:57.269514 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.268594    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.269514 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.268956    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 01:20:56 +0000 UTC" deadline="2028-02-21 17:47:48.248386085 +0000 UTC"
Jul 28 01:25:57.269514 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.269062    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13768h21m50.979329141s"
Jul 28 01:25:57.270278 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.270254    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.270461 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.270441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.270687 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.270660    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 01:25:57.270746 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.270708    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.270835 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.270819    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d9zmp\""
Jul 28 01:25:57.272118 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.272094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l98wn\""
Jul 28 01:25:57.272118 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.272118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.272341 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.272165    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.272622 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.272604    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.274265 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274248    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:25:57.274381 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274364    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 01:25:57.274441 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pr6f5\""
Jul 28 01:25:57.274441 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274380    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 01:25:57.274576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274367    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"
Jul 28 01:25:57.274789 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.274773    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 01:25:57.275559 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.275544    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal"]
Jul 28 01:25:57.276868 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.276849    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:25:57.281128 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.281111    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:25:57.281267 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.281218    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal"]
Jul 28 01:25:57.293825 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.293809    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:25:57.298284 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.298261    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rfzjs"
Jul 28 01:25:57.303701 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.303680    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rfzjs"
Jul 28 01:25:57.359813 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.359796    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 01:25:57.367580 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-modprobe-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-sys\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-systemd\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-lib-modules\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.367678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-multus\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-multus\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-sys\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-systemd\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-systemd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-modprobe-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-config\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-env-overrides\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-lib-modules\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-tmp-dir\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-systemd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-sys-fs\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-system-cni-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-system-cni-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.367986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-netns\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-netns\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-multus-certs\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-bin\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-multus-certs\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-bin\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec88b96-00b0-4c01-9735-97c322adff03-host\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kml92\" (UniqueName: \"kubernetes.io/projected/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-kube-api-access-kml92\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-cnibin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-slash\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ec88b96-00b0-4c01-9735-97c322adff03-serviceca\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-cnibin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2p86\" (UniqueName: \"kubernetes.io/projected/0ec88b96-00b0-4c01-9735-97c322adff03-kube-api-access-b2p86\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-systemd-units\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-slash\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-var-lib-kubelet\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.368895 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-tuned\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-systemd-units\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-system-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-k8s-cni-cncf-io\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-env-overrides\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-system-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd6br\" (UniqueName: \"kubernetes.io/projected/cea807b4-1440-4ce0-9df4-b370eede16cc-kube-api-access-dd6br\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-var-lib-kubelet\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-config\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-host-slash\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-run-k8s-cni-cncf-io\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-host\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-host-slash\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-etc-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-log-socket\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-log-socket\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.369820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-host\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-etc-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-conf\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-d\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368755    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-script-lib\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysctl-conf\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.368842    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-device-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.368932    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:57.868915784 +0000 UTC m=+1.993016246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43b5834e-ec09-4528-81ea-61434c05de0e-agent-certs\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.368999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-hostroot\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.370726 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-cni-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-hostroot\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-daemon-config\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-tmp\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-bin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-kubelet-config\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-dbus\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-cnibin\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovnkube-script-lib\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-iptables-alerter-script\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43b5834e-ec09-4528-81ea-61434c05de0e-konnectivity-ca\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-run\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-cni-bin\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-cnibin\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.371633 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cea807b4-1440-4ce0-9df4-b370eede16cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-kubelet\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrz4f\" (UniqueName: \"kubernetes.io/projected/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-kube-api-access-lrz4f\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-socket-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.369981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-netd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-hosts-file\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-run\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-os-release\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-socket-dir-parent\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-os-release\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg57n\" (UniqueName: \"kubernetes.io/projected/a61aff14-3b2b-4ac8-8274-635e5535b752-kube-api-access-pg57n\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ddl\" (UniqueName: \"kubernetes.io/projected/bb74f5be-8c87-4755-aab0-219dad056c51-kube-api-access-z9ddl\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-host-var-lib-kubelet\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-var-lib-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdl65\" (UniqueName: \"kubernetes.io/projected/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-kube-api-access-hdl65\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.372480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-os-release\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-conf-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-etc-kubernetes\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43b5834e-ec09-4528-81ea-61434c05de0e-konnectivity-ca\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-node-log\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-node-log\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysconfig\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-var-lib-openvswitch\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-cni-netd\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-sysconfig\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-socket-dir-parent\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-iptables-alerter-script\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-os-release\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-conf-dir\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-kubelet\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61aff14-3b2b-4ac8-8274-635e5535b752-etc-kubernetes\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-kubelet\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-netns\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-ovn\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7g7\" (UniqueName: \"kubernetes.io/projected/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-kube-api-access-zg7g7\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-registration-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjhfb\" (UniqueName: \"kubernetes.io/projected/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kube-api-access-gjhfb\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-run-ovn\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-cni-binary-copy\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.370977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-host-run-netns\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.371331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-kubernetes\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.371485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-kubernetes\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.371561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cea807b4-1440-4ce0-9df4-b370eede16cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.371857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-multus-daemon-config\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.371927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a61aff14-3b2b-4ac8-8274-635e5535b752-cni-binary-copy\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.372622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-etc-tuned\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.372776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43b5834e-ec09-4528-81ea-61434c05de0e-agent-certs\") pod \"konnectivity-agent-t2tkm\" (UID: \"43b5834e-ec09-4528-81ea-61434c05de0e\") " pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.373707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.373490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.374481 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.373980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-tmp\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.374926 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.374879    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:25:57.374926 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.374904    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:25:57.374926 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.374917    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:57.375119 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.374987    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:25:57.874969662 +0000 UTC m=+1.999070147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:57.378129 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.378102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kml92\" (UniqueName: \"kubernetes.io/projected/45d68a4a-4adb-4fa6-99d7-67de6c4b6bed-kube-api-access-kml92\") pod \"tuned-qm2v8\" (UID: \"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed\") " pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.378242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.378178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd6br\" (UniqueName: \"kubernetes.io/projected/cea807b4-1440-4ce0-9df4-b370eede16cc-kube-api-access-dd6br\") pod \"multus-additional-cni-plugins-kwjnd\" (UID: \"cea807b4-1440-4ce0-9df4-b370eede16cc\") " pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.379252 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.379228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrz4f\" (UniqueName: \"kubernetes.io/projected/3b0d5cc7-1817-41c9-b23f-affeb6cc48a7-kube-api-access-lrz4f\") pod \"ovnkube-node-zxgq6\" (UID: \"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.380423 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.380401    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ddl\" (UniqueName: \"kubernetes.io/projected/bb74f5be-8c87-4755-aab0-219dad056c51-kube-api-access-z9ddl\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.380507 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.380410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg57n\" (UniqueName: \"kubernetes.io/projected/a61aff14-3b2b-4ac8-8274-635e5535b752-kube-api-access-pg57n\") pod \"multus-qjndz\" (UID: \"a61aff14-3b2b-4ac8-8274-635e5535b752\") " pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.381181 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.381155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdl65\" (UniqueName: \"kubernetes.io/projected/614cafc4-6fe0-402d-9677-9f9e9c1c42c7-kube-api-access-hdl65\") pod \"iptables-alerter-4lj4f\" (UID: \"614cafc4-6fe0-402d-9677-9f9e9c1c42c7\") " pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.408826 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.408789    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d84437a22a1c0a2760cb8e46a57acd1.slice/crio-bfd5a2c9932b75efb15c2d6ef91769228c99dd4d5aefc2548e482698040bc821 WatchSource:0}: Error finding container bfd5a2c9932b75efb15c2d6ef91769228c99dd4d5aefc2548e482698040bc821: Status 404 returned error can't find the container with id bfd5a2c9932b75efb15c2d6ef91769228c99dd4d5aefc2548e482698040bc821
Jul 28 01:25:57.409023 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.409008    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c8aad278362c556bdbb4738c85bc81.slice/crio-4d55318d1a964a600d0e546fd454eb03a5c1224e54aae536519f550bd2cb5e05 WatchSource:0}: Error finding container 4d55318d1a964a600d0e546fd454eb03a5c1224e54aae536519f550bd2cb5e05: Status 404 returned error can't find the container with id 4d55318d1a964a600d0e546fd454eb03a5c1224e54aae536519f550bd2cb5e05
Jul 28 01:25:57.414209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.414189    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:25:57.416662 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.416641    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:25:57.472683 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472683 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-device-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-kubelet-config\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-dbus\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-socket-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-kubelet-config\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-hosts-file\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-device-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7g7\" (UniqueName: \"kubernetes.io/projected/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-kube-api-access-zg7g7\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-registration-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.472928 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjhfb\" (UniqueName: \"kubernetes.io/projected/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kube-api-access-gjhfb\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be464c89-fd49-42df-87c7-04f020c01aa1-dbus\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-socket-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-registration-dir\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-tmp-dir\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.472989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-hosts-file\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-sys-fs\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec88b96-00b0-4c01-9735-97c322adff03-host\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd82ad2a-b596-4976-93d6-5a29d8c787f1-sys-fs\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ec88b96-00b0-4c01-9735-97c322adff03-serviceca\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2p86\" (UniqueName: \"kubernetes.io/projected/0ec88b96-00b0-4c01-9735-97c322adff03-kube-api-access-b2p86\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.473195    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec88b96-00b0-4c01-9735-97c322adff03-host\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.473249    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:57.973233991 +0000 UTC m=+2.097334463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-tmp-dir\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.473561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.473525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ec88b96-00b0-4c01-9735-97c322adff03-serviceca\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.482099 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.482069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7g7\" (UniqueName: \"kubernetes.io/projected/eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89-kube-api-access-zg7g7\") pod \"node-resolver-vg9gk\" (UID: \"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89\") " pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.482261 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.482242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjhfb\" (UniqueName: \"kubernetes.io/projected/bd82ad2a-b596-4976-93d6-5a29d8c787f1-kube-api-access-gjhfb\") pod \"aws-ebs-csi-driver-node-pbjnh\" (UID: \"bd82ad2a-b596-4976-93d6-5a29d8c787f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.486723 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.486703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2p86\" (UniqueName: \"kubernetes.io/projected/0ec88b96-00b0-4c01-9735-97c322adff03-kube-api-access-b2p86\") pod \"node-ca-qfwhr\" (UID: \"0ec88b96-00b0-4c01-9735-97c322adff03\") " pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.577879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.577797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwjnd"
Jul 28 01:25:57.586649 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.586626    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea807b4_1440_4ce0_9df4_b370eede16cc.slice/crio-ea24d744aa20364b7aeedeef2ba7862fc63d8d5c247c1e2a8b0a4f04d4ed23c9 WatchSource:0}: Error finding container ea24d744aa20364b7aeedeef2ba7862fc63d8d5c247c1e2a8b0a4f04d4ed23c9: Status 404 returned error can't find the container with id ea24d744aa20364b7aeedeef2ba7862fc63d8d5c247c1e2a8b0a4f04d4ed23c9
Jul 28 01:25:57.600350 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.600324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qjndz"
Jul 28 01:25:57.606492 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.606467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lj4f"
Jul 28 01:25:57.607920 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.607899    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61aff14_3b2b_4ac8_8274_635e5535b752.slice/crio-44ef37e79674e04e53d8cf6ae5b4f4a3b40bda39587ac15607c29cbf750ce29e WatchSource:0}: Error finding container 44ef37e79674e04e53d8cf6ae5b4f4a3b40bda39587ac15607c29cbf750ce29e: Status 404 returned error can't find the container with id 44ef37e79674e04e53d8cf6ae5b4f4a3b40bda39587ac15607c29cbf750ce29e
Jul 28 01:25:57.614402 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.614375    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614cafc4_6fe0_402d_9677_9f9e9c1c42c7.slice/crio-0a59269624ea4cef1ce2105765e2f987d8eaf14cc16c31a4cf4eb6bc48043962 WatchSource:0}: Error finding container 0a59269624ea4cef1ce2105765e2f987d8eaf14cc16c31a4cf4eb6bc48043962: Status 404 returned error can't find the container with id 0a59269624ea4cef1ce2105765e2f987d8eaf14cc16c31a4cf4eb6bc48043962
Jul 28 01:25:57.616831 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.616815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:25:57.623847 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.623826    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b5834e_ec09_4528_81ea_61434c05de0e.slice/crio-ff9a0f2db1fdeec789be08260b5e4f63f0654cb766a5de4d0a0eb9592ab4422c WatchSource:0}: Error finding container ff9a0f2db1fdeec789be08260b5e4f63f0654cb766a5de4d0a0eb9592ab4422c: Status 404 returned error can't find the container with id ff9a0f2db1fdeec789be08260b5e4f63f0654cb766a5de4d0a0eb9592ab4422c
Jul 28 01:25:57.642417 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.642393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm2v8"
Jul 28 01:25:57.649548 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.649525    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d68a4a_4adb_4fa6_99d7_67de6c4b6bed.slice/crio-9386b76495c0057b056d9e9dccfa2528c07c992803d1affcf689d8a00b08a556 WatchSource:0}: Error finding container 9386b76495c0057b056d9e9dccfa2528c07c992803d1affcf689d8a00b08a556: Status 404 returned error can't find the container with id 9386b76495c0057b056d9e9dccfa2528c07c992803d1affcf689d8a00b08a556
Jul 28 01:25:57.653708 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.653690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:25:57.662048 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.661991    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0d5cc7_1817_41c9_b23f_affeb6cc48a7.slice/crio-a143214ce7679b9e44a205ff1fe45eef94f21ab107dadbbcc31015121ffed137 WatchSource:0}: Error finding container a143214ce7679b9e44a205ff1fe45eef94f21ab107dadbbcc31015121ffed137: Status 404 returned error can't find the container with id a143214ce7679b9e44a205ff1fe45eef94f21ab107dadbbcc31015121ffed137
Jul 28 01:25:57.673674 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.673656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh"
Jul 28 01:25:57.681466 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.681444    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd82ad2a_b596_4976_93d6_5a29d8c787f1.slice/crio-4dac8fd633cfaab8f04936e491102adc018fd20ab6defa067878e5f4c971ac82 WatchSource:0}: Error finding container 4dac8fd633cfaab8f04936e491102adc018fd20ab6defa067878e5f4c971ac82: Status 404 returned error can't find the container with id 4dac8fd633cfaab8f04936e491102adc018fd20ab6defa067878e5f4c971ac82
Jul 28 01:25:57.694898 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.694872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vg9gk"
Jul 28 01:25:57.700388 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.700346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qfwhr"
Jul 28 01:25:57.702754 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.702735    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6ce0b0_6fe4_4bc3_92bc_773b8c5f9b89.slice/crio-19f8eeb9f6b8c42b7fdbf7923a06098d1f337a950d9bcce8edb90747d7d9cced WatchSource:0}: Error finding container 19f8eeb9f6b8c42b7fdbf7923a06098d1f337a950d9bcce8edb90747d7d9cced: Status 404 returned error can't find the container with id 19f8eeb9f6b8c42b7fdbf7923a06098d1f337a950d9bcce8edb90747d7d9cced
Jul 28 01:25:57.708382 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:25:57.708362    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec88b96_00b0_4c01_9735_97c322adff03.slice/crio-758de8e2e969fb9982d49de17b47960a1592e50c9563b03798a9dbb340be33f1 WatchSource:0}: Error finding container 758de8e2e969fb9982d49de17b47960a1592e50c9563b03798a9dbb340be33f1: Status 404 returned error can't find the container with id 758de8e2e969fb9982d49de17b47960a1592e50c9563b03798a9dbb340be33f1
Jul 28 01:25:57.875077 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.874980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:57.875077 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.875052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875091    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875158    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:58.875139623 +0000 UTC m=+2.999240101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875158    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875177    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875190    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:57.875259 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.875227    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:25:58.875215499 +0000 UTC m=+2.999315975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:57.975522 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:57.975481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:57.975729 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.975676    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:57.975790 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:57.975755    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:25:58.975733844 +0000 UTC m=+3.099834307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:58.306344 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.306222    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:20:57 +0000 UTC" deadline="2028-03-25 12:06:36.541021215 +0000 UTC"
Jul 28 01:25:58.306344 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.306292    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14554h40m38.234733896s"
Jul 28 01:25:58.443201 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.443133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t2tkm" event={"ID":"43b5834e-ec09-4528-81ea-61434c05de0e","Type":"ContainerStarted","Data":"ff9a0f2db1fdeec789be08260b5e4f63f0654cb766a5de4d0a0eb9592ab4422c"}
Jul 28 01:25:58.452061 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.451959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lj4f" event={"ID":"614cafc4-6fe0-402d-9677-9f9e9c1c42c7","Type":"ContainerStarted","Data":"0a59269624ea4cef1ce2105765e2f987d8eaf14cc16c31a4cf4eb6bc48043962"}
Jul 28 01:25:58.455926 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.455886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qjndz" event={"ID":"a61aff14-3b2b-4ac8-8274-635e5535b752","Type":"ContainerStarted","Data":"44ef37e79674e04e53d8cf6ae5b4f4a3b40bda39587ac15607c29cbf750ce29e"}
Jul 28 01:25:58.461266 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.461178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerStarted","Data":"ea24d744aa20364b7aeedeef2ba7862fc63d8d5c247c1e2a8b0a4f04d4ed23c9"}
Jul 28 01:25:58.465014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.464845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vg9gk" event={"ID":"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89","Type":"ContainerStarted","Data":"19f8eeb9f6b8c42b7fdbf7923a06098d1f337a950d9bcce8edb90747d7d9cced"}
Jul 28 01:25:58.480064 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.479641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal" event={"ID":"0d84437a22a1c0a2760cb8e46a57acd1","Type":"ContainerStarted","Data":"bfd5a2c9932b75efb15c2d6ef91769228c99dd4d5aefc2548e482698040bc821"}
Jul 28 01:25:58.489248 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.489206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal" event={"ID":"f3c8aad278362c556bdbb4738c85bc81","Type":"ContainerStarted","Data":"4d55318d1a964a600d0e546fd454eb03a5c1224e54aae536519f550bd2cb5e05"}
Jul 28 01:25:58.502242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.502196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qfwhr" event={"ID":"0ec88b96-00b0-4c01-9735-97c322adff03","Type":"ContainerStarted","Data":"758de8e2e969fb9982d49de17b47960a1592e50c9563b03798a9dbb340be33f1"}
Jul 28 01:25:58.505558 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.505523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh" event={"ID":"bd82ad2a-b596-4976-93d6-5a29d8c787f1","Type":"ContainerStarted","Data":"4dac8fd633cfaab8f04936e491102adc018fd20ab6defa067878e5f4c971ac82"}
Jul 28 01:25:58.520774 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.520732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"a143214ce7679b9e44a205ff1fe45eef94f21ab107dadbbcc31015121ffed137"}
Jul 28 01:25:58.528546 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.528386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm2v8" event={"ID":"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed","Type":"ContainerStarted","Data":"9386b76495c0057b056d9e9dccfa2528c07c992803d1affcf689d8a00b08a556"}
Jul 28 01:25:58.715396 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.715304    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:25:58.884503 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.884456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:58.884503 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.884509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:58.884773 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884662    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:25:58.884773 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884677    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:25:58.884773 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884687    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:58.884773 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884743    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:26:00.884726958 +0000 UTC m=+5.008827443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:25:58.884991 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884817    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:58.884991 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.884841    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:00.884833688 +0000 UTC m=+5.008934152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:25:58.985058 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:58.984944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:58.985240 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.985185    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:58.985311 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:58.985260    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:00.985237844 +0000 UTC m=+5.109338314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:25:59.307213 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:59.307111    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:20:57 +0000 UTC" deadline="2028-04-08 19:06:41.822137728 +0000 UTC"
Jul 28 01:25:59.307213 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:59.307160    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14897h40m42.514983985s"
Jul 28 01:25:59.393362 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:59.393326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:25:59.393546 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:59.393475    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:25:59.393962 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:59.393936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:25:59.394118 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:59.394094    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:25:59.394193 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:25:59.394179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:25:59.394284 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:25:59.394266    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:00.902993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:00.903069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903241    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903264    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903280    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903343    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:26:04.903323085 +0000 UTC m=+9.027423564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903884    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:00.904080 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:00.903988    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:04.903970165 +0000 UTC m=+9.028070641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:01.003825 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:01.003780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:01.004028 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:01.003981    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:01.004098 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:01.004076    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:05.004055944 +0000 UTC m=+9.128156407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:01.394191 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:01.394103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:01.394363 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:01.394258    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:01.394728 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:01.394706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:01.394843 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:01.394812    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:01.394910 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:01.394891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:01.394998 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:01.394975    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:03.393851 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:03.393812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:03.394432 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:03.393962    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:03.394432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:03.394055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:03.394432 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:03.394138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:03.394432 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:03.394195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:03.394432 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:03.394278    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:04.939553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:04.939606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939711    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939735    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939752    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939765    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939781    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:12.939761614 +0000 UTC m=+17.063862089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:04.939829 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:04.939801    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:26:12.939790504 +0000 UTC m=+17.063890966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:05.040345 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:05.040314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:05.040512 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:05.040448    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:05.040512 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:05.040499    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:13.040484358 +0000 UTC m=+17.164584820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:05.393611 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:05.393515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:05.393777 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:05.393624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:05.393777 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:05.393762    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:05.394051 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:05.394013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:05.394169 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:05.394101    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:05.394241 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:05.394195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:07.393460 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:07.393428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:07.393914 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:07.393551    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:07.394015 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:07.393939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:07.394076 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:07.394048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:07.394076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:07.394056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:07.394179 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:07.394118    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:09.394049 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:09.394014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:09.394480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:09.394021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:09.394480 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:09.394138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:09.394480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:09.394029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:09.394480 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:09.394231    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:09.394480 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:09.394279    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:11.393684 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:11.393650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:11.394192 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:11.393724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:11.394192 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:11.393826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:11.394192 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:11.393844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:11.394192 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:11.393919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:11.394192 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:11.394005    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:12.998345 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:12.998304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:12.998387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998493    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998527    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998552    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.998532792 +0000 UTC m=+33.122633253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998554    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998572    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:12.998802 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:12.998637    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:26:28.998621474 +0000 UTC m=+33.122721950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:13.099026 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:13.098986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:13.099196 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:13.099083    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:13.099196 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:13.099151    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:29.09913165 +0000 UTC m=+33.223232110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:13.393436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:13.393347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:13.393436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:13.393421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:13.393657 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:13.393552    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:13.393657 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:13.393576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:13.393753 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:13.393684    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:13.393809 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:13.393787    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:15.393540 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:15.393490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:15.394001 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:15.393490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:15.394001 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:15.393646    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:15.394001 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:15.393490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:15.394001 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:15.393713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:15.394001 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:15.393770    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:17.393256 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:17.393219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:17.393703 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:17.393259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:17.393703 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:17.393221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:17.393703 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:17.393342    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:17.393703 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:17.393441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:17.393703 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:17.393540    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:18.590420 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.590269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qjndz" event={"ID":"a61aff14-3b2b-4ac8-8274-635e5535b752","Type":"ContainerStarted","Data":"32c1eb39b8d539654ae6bc6eb5b37468088eeef1adafee3d36fdf42f7fc487bb"}
Jul 28 01:26:18.595417 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.594949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal" event={"ID":"0d84437a22a1c0a2760cb8e46a57acd1","Type":"ContainerStarted","Data":"4b57da10110417954fee79020346b2d8226a5bbadb1c8f8208b759e760281f0e"}
Jul 28 01:26:18.600550 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.600525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"293c35c7039508748c394e59c9b1e18bc51a40dc6371a901ba061bb447b8c000"}
Jul 28 01:26:18.602190 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.601855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm2v8" event={"ID":"45d68a4a-4adb-4fa6-99d7-67de6c4b6bed","Type":"ContainerStarted","Data":"3ccdc3fc04537dfc918dc41bb50ab4cb40b48c0118e128f4b111a45d6daf42f7"}
Jul 28 01:26:18.607093 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.606555    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qjndz" podStartSLOduration=0.752726247 podStartE2EDuration="21.60653794s" totalImagesPullingTime="20.853811693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:18.605768551 +0000 UTC m=+22.729869032" watchObservedRunningTime="2026-07-28 01:26:18.60653794 +0000 UTC m=+22.730638421"
Jul 28 01:26:18.622012 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.620397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-153.ec2.internal" podStartSLOduration=21.620359348 podStartE2EDuration="21.620359348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:18.620011113 +0000 UTC m=+22.744111594" watchObservedRunningTime="2026-07-28 01:26:18.620359348 +0000 UTC m=+22.744459829"
Jul 28 01:26:18.641993 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:18.638755    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qm2v8" podStartSLOduration=0.859423106 podStartE2EDuration="21.638735121s" totalImagesPullingTime="20.779312015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:18.634812583 +0000 UTC m=+22.758913064" watchObservedRunningTime="2026-07-28 01:26:18.638735121 +0000 UTC m=+22.762835601"
Jul 28 01:26:19.393269 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.393184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:19.393269 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.393230    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:19.393451 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.393289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:19.393451 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:19.393304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:19.393451 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:19.393363    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:19.393451 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:19.393419    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:19.605714 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.605489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh" event={"ID":"bd82ad2a-b596-4976-93d6-5a29d8c787f1","Type":"ContainerStarted","Data":"e5fba526e8628c27dc6354910b04a6bf206c35be4e192435ab495bdf221edd8e"}
Jul 28 01:26:19.608385 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.608344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"9baf318450047298af1dc8c3e2906425b479bc80ab36827fdb4c79f52a0375c8"}
Jul 28 01:26:19.608478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.608420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"256fb8e0ea6dfeb3bef32d7bf6bede10b71e812f31dfd34215c547f242376832"}
Jul 28 01:26:19.608478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.608467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"fdb5a3bc3e7e1a2c0bc29fce7765143dcf1a495af7d11b9f8aedc5f7bf3a956e"}
Jul 28 01:26:19.608580 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.608505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"ace52d00b3f4b5b5622fb2539f532b3f24c0ac74aa2f31f5cd80fae703be1672"}
Jul 28 01:26:19.608580 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.608536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"96f10ab12c1497f36f2f3f7e61fd57bd7a8f29bc98db4450bd596d9f26735c58"}
Jul 28 01:26:19.609662 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.609641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t2tkm" event={"ID":"43b5834e-ec09-4528-81ea-61434c05de0e","Type":"ContainerStarted","Data":"3020af60c9eb675442225cf8f622089059eb727629db699c9497ac8c68437353"}
Jul 28 01:26:19.611137 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.611114    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="3f2a8712b23b8901622978ed216dbed3c479b8f214d77b45900ff44d9725b4ad" exitCode=0
Jul 28 01:26:19.611230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.611178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"3f2a8712b23b8901622978ed216dbed3c479b8f214d77b45900ff44d9725b4ad"}
Jul 28 01:26:19.612610 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.612590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vg9gk" event={"ID":"eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89","Type":"ContainerStarted","Data":"f58f96c2f87250e26975cd05aa9f8af428d336591de8626b292e39a21b90de64"}
Jul 28 01:26:19.614021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.614003    2579 generic.go:356] "Generic (PLEG): container finished" podID="f3c8aad278362c556bdbb4738c85bc81" containerID="d6c9bfd99425b917724631f60a9a3b9768b56436b595590ecb2c905d3de904a3" exitCode=0
Jul 28 01:26:19.614121 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.614062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal" event={"ID":"f3c8aad278362c556bdbb4738c85bc81","Type":"ContainerDied","Data":"d6c9bfd99425b917724631f60a9a3b9768b56436b595590ecb2c905d3de904a3"}
Jul 28 01:26:19.615410 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.615385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qfwhr" event={"ID":"0ec88b96-00b0-4c01-9735-97c322adff03","Type":"ContainerStarted","Data":"26268ec73385a5b10e3e0d5acc9c071cdafa21a087bf6bfe8255a05b58a8a696"}
Jul 28 01:26:19.622651 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.622615    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t2tkm" podStartSLOduration=1.837086848 podStartE2EDuration="22.622601985s" totalImagesPullingTime="20.785515137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:19.622417003 +0000 UTC m=+23.746517484" watchObservedRunningTime="2026-07-28 01:26:19.622601985 +0000 UTC m=+23.746702466"
Jul 28 01:26:19.635914 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.635865    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vg9gk" podStartSLOduration=1.930168734 podStartE2EDuration="22.63584907s" totalImagesPullingTime="20.705680336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:19.635625352 +0000 UTC m=+23.759725832" watchObservedRunningTime="2026-07-28 01:26:19.63584907 +0000 UTC m=+23.759949550"
Jul 28 01:26:19.647393 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:19.647278    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qfwhr" podStartSLOduration=1.944284889 podStartE2EDuration="22.647266292s" totalImagesPullingTime="20.702981403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:19.647074666 +0000 UTC m=+23.771175146" watchObservedRunningTime="2026-07-28 01:26:19.647266292 +0000 UTC m=+23.771366773"
Jul 28 01:26:20.255956 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.255919    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 01:26:20.332924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.332785    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:26:20.255948305Z","UUID":"18013160-ab29-4f79-a5af-904922ac961b","Handler":null,"Name":"","Endpoint":""}
Jul 28 01:26:20.334490 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.334470    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 01:26:20.334616 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.334516    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 01:26:20.620196 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.620153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal" event={"ID":"f3c8aad278362c556bdbb4738c85bc81","Type":"ContainerStarted","Data":"d138d5f8915546862073a3b300e06f29fa3af5977432bdc067008941777c5b44"}
Jul 28 01:26:20.622561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.622526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh" event={"ID":"bd82ad2a-b596-4976-93d6-5a29d8c787f1","Type":"ContainerStarted","Data":"40854ec0a9603e9d77f0085516f4d20f987e5a35a78b3345e3a8d1808b889998"}
Jul 28 01:26:20.624602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.624147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lj4f" event={"ID":"614cafc4-6fe0-402d-9677-9f9e9c1c42c7","Type":"ContainerStarted","Data":"49d14890a6f2f5dc98aa96a52b3bff4fa9b01105228a0cfa715e461ec95af879"}
Jul 28 01:26:20.634626 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.634567    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-153.ec2.internal" podStartSLOduration=23.634546527 podStartE2EDuration="23.634546527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:20.634051951 +0000 UTC m=+24.758152434" watchObservedRunningTime="2026-07-28 01:26:20.634546527 +0000 UTC m=+24.758647008"
Jul 28 01:26:20.646488 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:20.646417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4lj4f" podStartSLOduration=2.852134108 podStartE2EDuration="23.646401309s" totalImagesPullingTime="20.794267201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:20.646045453 +0000 UTC m=+24.770145935" watchObservedRunningTime="2026-07-28 01:26:20.646401309 +0000 UTC m=+24.770501791"
Jul 28 01:26:21.393550 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.393513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:21.393754 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.393528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:21.393754 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:21.393633    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:21.393754 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.393657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:21.393754 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:21.393737    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:21.393942 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:21.393810    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:21.629088 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.629053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh" event={"ID":"bd82ad2a-b596-4976-93d6-5a29d8c787f1","Type":"ContainerStarted","Data":"21d712a9eee0a4449e7a9377379bedada05549069bc539022e4e48a842f68f64"}
Jul 28 01:26:21.633038 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.633005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"0ddd7734fff4a5105bd917aef200c1226a7478deef918017e32cebcaf0ba198e"}
Jul 28 01:26:21.646920 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.646880    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pbjnh" podStartSLOduration=1.572480265 podStartE2EDuration="24.646862991s" totalImagesPullingTime="23.074382726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:21.645997376 +0000 UTC m=+25.770097851" watchObservedRunningTime="2026-07-28 01:26:21.646862991 +0000 UTC m=+25.770963473"
Jul 28 01:26:21.793207 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.793171    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:26:21.794098 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:21.794078    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:26:23.393677 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:23.393648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:23.394167 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:23.393648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:23.394167 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:23.393757    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:23.394167 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:23.393811    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:23.394167 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:23.393663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:23.394167 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:23.393907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:24.641146 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.640939    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="c10fd9918fe3714d5b430f5505b20f8d0c75edd9d571887f904d4c45fb218aed" exitCode=0
Jul 28 01:26:24.641912 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.641003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"c10fd9918fe3714d5b430f5505b20f8d0c75edd9d571887f904d4c45fb218aed"}
Jul 28 01:26:24.645152 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.645116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" event={"ID":"3b0d5cc7-1817-41c9-b23f-affeb6cc48a7","Type":"ContainerStarted","Data":"fa6877bd01071365d136cb46d1575df392d669489ba3f06bc6ced1371449e388"}
Jul 28 01:26:24.645426 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.645408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:24.645485 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.645477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:24.660998 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.660954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:24.683081 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:24.683030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6" podStartSLOduration=6.870886467 podStartE2EDuration="27.683015703s" totalImagesPullingTime="20.812129236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:24.682570085 +0000 UTC m=+28.806670562" watchObservedRunningTime="2026-07-28 01:26:24.683015703 +0000 UTC m=+28.807116183"
Jul 28 01:26:25.393149 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.393117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:25.393378 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.393124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:25.393378 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.393231    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:25.393378 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.393292    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:25.393378 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.393129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:25.393378 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.393362    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:25.648226 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.648060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:25.665111 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.664962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:25.889038 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.889009    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b6s48"]
Jul 28 01:26:25.889357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.889099    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:25.889357 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.889200    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:25.889654 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.889632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vcp24"]
Jul 28 01:26:25.889752 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.889735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:25.889836 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.889815    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:25.900251 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.900186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97l5d"]
Jul 28 01:26:25.900372 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:25.900313    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:25.900445 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:25.900424    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:26.542118 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:26.542083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:26:26.542301 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:26.542207    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 01:26:26.542768 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:26.542750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t2tkm"
Jul 28 01:26:26.651947 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:26.651913    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="d482964c19bf512db15571b5938ecb1d4a63f7095050a65649ef6e57687761de" exitCode=0
Jul 28 01:26:26.652450 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:26.651983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"d482964c19bf512db15571b5938ecb1d4a63f7095050a65649ef6e57687761de"}
Jul 28 01:26:27.394102 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:27.394058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:27.394326 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:27.394061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:27.394326 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:27.394159    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:27.394326 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:27.394242    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:27.394326 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:27.394063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:27.394535 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:27.394328    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:28.658898 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:28.658863    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="c422061038d988363efe8133f533a21206f6e84854652da8fd947099ff707345" exitCode=0
Jul 28 01:26:28.659276 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:28.658907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"c422061038d988363efe8133f533a21206f6e84854652da8fd947099ff707345"}
Jul 28 01:26:29.017470 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.017428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.017482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017601    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017614    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017639    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017651    2579 projected.go:196] Error preparing data for projected volume kube-api-access-nkr9z for pod openshift-network-diagnostics/network-check-target-97l5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:29.017694 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017676    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs podName:bb74f5be-8c87-4755-aab0-219dad056c51 nodeName:}" failed. No retries permitted until 2026-07-28 01:27:01.017658638 +0000 UTC m=+65.141759099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs") pod "network-metrics-daemon-vcp24" (UID: "bb74f5be-8c87-4755-aab0-219dad056c51") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:29.017903 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.017700    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z podName:415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f nodeName:}" failed. No retries permitted until 2026-07-28 01:27:01.017684956 +0000 UTC m=+65.141785432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkr9z" (UniqueName: "kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z") pod "network-check-target-97l5d" (UID: "415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:29.118665 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.118627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:29.118841 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.118783    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:29.118891 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.118884    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret podName:be464c89-fd49-42df-87c7-04f020c01aa1 nodeName:}" failed. No retries permitted until 2026-07-28 01:27:01.118865254 +0000 UTC m=+65.242965717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret") pod "global-pull-secret-syncer-b6s48" (UID: "be464c89-fd49-42df-87c7-04f020c01aa1") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:29.394200 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.394116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:29.394200 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.394127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:29.394428 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.394115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:29.394428 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.394254    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:29.394428 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.394401    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:29.394564 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:29.394526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:29.629305 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:29.629272    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vg9gk_eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89/dns-node-resolver/0.log"
Jul 28 01:26:30.600390 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:30.600362    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qfwhr_0ec88b96-00b0-4c01-9735-97c322adff03/node-ca/0.log"
Jul 28 01:26:31.394047 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:31.394015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:31.394231 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:31.394015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:31.394231 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:31.394136    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b6s48" podUID="be464c89-fd49-42df-87c7-04f020c01aa1"
Jul 28 01:26:31.394231 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:31.394021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:31.394384 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:31.394230    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97l5d" podUID="415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f"
Jul 28 01:26:31.394384 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:31.394322    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vcp24" podUID="bb74f5be-8c87-4755-aab0-219dad056c51"
Jul 28 01:26:32.188996 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:32.188906    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-153.ec2.internal" event="NodeReady"
Jul 28 01:26:32.189436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:32.189075    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 01:26:33.393663 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.393619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:26:33.394108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.393730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:26:33.394108 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.393757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:26:33.396049 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:26:33.396499 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396478    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:26:33.396620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptgdn\""
Jul 28 01:26:33.396620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396521    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:26:33.396620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:26:33.396802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.396786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xpqm\""
Jul 28 01:26:33.677620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.677540    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="b12ebd55b33432f0c5dcf6a66368180aab02e5f51e955fe29ba1b689632d10c4" exitCode=0
Jul 28 01:26:33.677620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:33.677585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"b12ebd55b33432f0c5dcf6a66368180aab02e5f51e955fe29ba1b689632d10c4"}
Jul 28 01:26:34.682880 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:34.682854    2579 generic.go:356] "Generic (PLEG): container finished" podID="cea807b4-1440-4ce0-9df4-b370eede16cc" containerID="3da9f7e58ddc7e7ef425cf3f7e1eaf7fb165ed3cd2dcfa9194be8b026562c022" exitCode=0
Jul 28 01:26:34.683404 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:34.682899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerDied","Data":"3da9f7e58ddc7e7ef425cf3f7e1eaf7fb165ed3cd2dcfa9194be8b026562c022"}
Jul 28 01:26:35.691009 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:35.688660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" event={"ID":"cea807b4-1440-4ce0-9df4-b370eede16cc","Type":"ContainerStarted","Data":"041c818c5a3a3c52d0566691b77007ab77b786145d1fe6115c138c2133e5e640"}
Jul 28 01:26:35.711325 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:35.711281    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kwjnd" podStartSLOduration=7.705190293 podStartE2EDuration="38.711265157s" totalImagesPullingTime="31.006074864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:35.710253226 +0000 UTC m=+39.834353705" watchObservedRunningTime="2026-07-28 01:26:35.711265157 +0000 UTC m=+39.835365638"
Jul 28 01:26:51.571333 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.571301    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-x2fg5"]
Jul 28 01:26:51.593282 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.593241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:26:51.596256 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.596236    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kxbn5\""
Jul 28 01:26:51.596687 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.596669    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 01:26:51.596759 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.596741    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 01:26:51.611346 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.611309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-x2fg5"]
Jul 28 01:26:51.615720 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.615696    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d587bf6b4-zppmq"]
Jul 28 01:26:51.637682 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.637650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.640233 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.640213    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 01:26:51.648292 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.648257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 01:26:51.648436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.648294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 01:26:51.648436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.648384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tgrjr\""
Jul 28 01:26:51.655177 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.655151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d587bf6b4-zppmq"]
Jul 28 01:26:51.661777 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.661748    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 01:26:51.669006 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.668957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r6vxb"]
Jul 28 01:26:51.690032 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.689994    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pl7jv"]
Jul 28 01:26:51.690275 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.690254    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.694988 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.694948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtm4s\""
Jul 28 01:26:51.695404 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.695046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 01:26:51.698022 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.698000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 01:26:51.712165 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.712129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pl7jv"]
Jul 28 01:26:51.712165 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.712168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6vxb"]
Jul 28 01:26:51.712369 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.712236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.715027 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.715004    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 01:26:51.715101 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.715068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 01:26:51.715511 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.715497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t6tn5\""
Jul 28 01:26:51.715941 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.715929    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 01:26:51.747871 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.747836    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tlr62"]
Jul 28 01:26:51.768114 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.768087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlr62"]
Jul 28 01:26:51.768229 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.768198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.770116 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.770098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfwwc\""
Jul 28 01:26:51.770230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.770187    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 01:26:51.770294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.770235    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 01:26:51.770504 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.770488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 01:26:51.770601 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.770587    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 01:26:51.774860 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.774843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hppp\" (UniqueName: \"kubernetes.io/projected/c3652c76-ed8f-461d-8241-a9778f207c58-kube-api-access-5hppp\") pod \"downloads-7c97dc4555-x2fg5\" (UID: \"c3652c76-ed8f-461d-8241-a9778f207c58\") " pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:26:51.774924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.774885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c628472c-dbbd-47e1-a86e-f0b9a5306da6-config-volume\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.774924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.774902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c628472c-dbbd-47e1-a86e-f0b9a5306da6-tmp-dir\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.775033 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.774942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj298\" (UniqueName: \"kubernetes.io/projected/c628472c-dbbd-47e1-a86e-f0b9a5306da6-kube-api-access-lj298\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.775033 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.774993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-image-registry-private-configuration\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-registry-tls\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-installation-pull-secrets\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-trusted-ca\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-bound-sa-token\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbt6z\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-kube-api-access-lbt6z\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c628472c-dbbd-47e1-a86e-f0b9a5306da6-metrics-tls\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.775185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/444364e4-db25-4d41-a654-57607913a7d7-ca-trust-extracted\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.775303 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.775232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-registry-certificates\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876473 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-trusted-ca\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876473 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-bound-sa-token\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876473 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbt6z\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-kube-api-access-lbt6z\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876473 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c628472c-dbbd-47e1-a86e-f0b9a5306da6-metrics-tls\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/444364e4-db25-4d41-a654-57607913a7d7-ca-trust-extracted\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c8e282e-73f2-4f26-9761-ecaad95c14b6-data-volume\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-registry-certificates\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c8e282e-73f2-4f26-9761-ecaad95c14b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hppp\" (UniqueName: \"kubernetes.io/projected/c3652c76-ed8f-461d-8241-a9778f207c58-kube-api-access-5hppp\") pod \"downloads-7c97dc4555-x2fg5\" (UID: \"c3652c76-ed8f-461d-8241-a9778f207c58\") " pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:26:51.876770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m44f\" (UniqueName: \"kubernetes.io/projected/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-api-access-8m44f\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c628472c-dbbd-47e1-a86e-f0b9a5306da6-config-volume\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c628472c-dbbd-47e1-a86e-f0b9a5306da6-tmp-dir\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj298\" (UniqueName: \"kubernetes.io/projected/c628472c-dbbd-47e1-a86e-f0b9a5306da6-kube-api-access-lj298\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-image-registry-private-configuration\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.876947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c8e282e-73f2-4f26-9761-ecaad95c14b6-crio-socket\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-cert\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.877097 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-registry-tls\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.877483 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-installation-pull-secrets\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.877483 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/444364e4-db25-4d41-a654-57607913a7d7-ca-trust-extracted\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.877483 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvm8p\" (UniqueName: \"kubernetes.io/projected/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-kube-api-access-hvm8p\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.877483 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c628472c-dbbd-47e1-a86e-f0b9a5306da6-tmp-dir\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.877483 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c628472c-dbbd-47e1-a86e-f0b9a5306da6-config-volume\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.877725 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-registry-certificates\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.877725 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.877625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/444364e4-db25-4d41-a654-57607913a7d7-trusted-ca\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.880846 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.880818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c628472c-dbbd-47e1-a86e-f0b9a5306da6-metrics-tls\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.880994 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.880957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-registry-tls\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.881115 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.881094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-image-registry-private-configuration\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.881175 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.881120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/444364e4-db25-4d41-a654-57607913a7d7-installation-pull-secrets\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.886152 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.886121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj298\" (UniqueName: \"kubernetes.io/projected/c628472c-dbbd-47e1-a86e-f0b9a5306da6-kube-api-access-lj298\") pod \"dns-default-r6vxb\" (UID: \"c628472c-dbbd-47e1-a86e-f0b9a5306da6\") " pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:51.886152 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.886134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbt6z\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-kube-api-access-lbt6z\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.887100 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.887077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/444364e4-db25-4d41-a654-57607913a7d7-bound-sa-token\") pod \"image-registry-7d587bf6b4-zppmq\" (UID: \"444364e4-db25-4d41-a654-57607913a7d7\") " pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.897894 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.897855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hppp\" (UniqueName: \"kubernetes.io/projected/c3652c76-ed8f-461d-8241-a9778f207c58-kube-api-access-5hppp\") pod \"downloads-7c97dc4555-x2fg5\" (UID: \"c3652c76-ed8f-461d-8241-a9778f207c58\") " pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:26:51.901689 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.901672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:26:51.946025 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.945986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:51.977839 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.977800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvm8p\" (UniqueName: \"kubernetes.io/projected/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-kube-api-access-hvm8p\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.978007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.977874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c8e282e-73f2-4f26-9761-ecaad95c14b6-data-volume\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.977910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c8e282e-73f2-4f26-9761-ecaad95c14b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.977939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m44f\" (UniqueName: \"kubernetes.io/projected/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-api-access-8m44f\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978171 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c8e282e-73f2-4f26-9761-ecaad95c14b6-crio-socket\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978171 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-cert\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.978171 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978171 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c8e282e-73f2-4f26-9761-ecaad95c14b6-crio-socket\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978352 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c8e282e-73f2-4f26-9761-ecaad95c14b6-data-volume\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.978661 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.978640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.980730 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.980704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c8e282e-73f2-4f26-9761-ecaad95c14b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.981007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.980764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-cert\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:51.985215 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.985187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m44f\" (UniqueName: \"kubernetes.io/projected/8c8e282e-73f2-4f26-9761-ecaad95c14b6-kube-api-access-8m44f\") pod \"insights-runtime-extractor-tlr62\" (UID: \"8c8e282e-73f2-4f26-9761-ecaad95c14b6\") " pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:51.985391 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:51.985373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvm8p\" (UniqueName: \"kubernetes.io/projected/a83c9cad-df78-4a37-9ac8-b7c87f513fe0-kube-api-access-hvm8p\") pod \"ingress-canary-pl7jv\" (UID: \"a83c9cad-df78-4a37-9ac8-b7c87f513fe0\") " pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:52.001009 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.000953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:52.021134 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.021030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pl7jv"
Jul 28 01:26:52.076758 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.076510    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlr62"
Jul 28 01:26:52.101322 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.101240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-x2fg5"]
Jul 28 01:26:52.107528 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:52.107499    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3652c76_ed8f_461d_8241_a9778f207c58.slice/crio-0ff0e6cfef06061c0979fd54b51dfceeaa395920f98a3e883cda278949dfc41c WatchSource:0}: Error finding container 0ff0e6cfef06061c0979fd54b51dfceeaa395920f98a3e883cda278949dfc41c: Status 404 returned error can't find the container with id 0ff0e6cfef06061c0979fd54b51dfceeaa395920f98a3e883cda278949dfc41c
Jul 28 01:26:52.120340 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.120041    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d587bf6b4-zppmq"]
Jul 28 01:26:52.125494 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:52.125450    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444364e4_db25_4d41_a654_57607913a7d7.slice/crio-bee72e8215be048b392a50806d4566202db41fe025fdeeb2cee09e116fe62b8d WatchSource:0}: Error finding container bee72e8215be048b392a50806d4566202db41fe025fdeeb2cee09e116fe62b8d: Status 404 returned error can't find the container with id bee72e8215be048b392a50806d4566202db41fe025fdeeb2cee09e116fe62b8d
Jul 28 01:26:52.179273 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.179228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6vxb"]
Jul 28 01:26:52.183348 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:52.183323    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc628472c_dbbd_47e1_a86e_f0b9a5306da6.slice/crio-f072941e62cba0ff1359e4e2ffa8404087542593598932489e2854a037378544 WatchSource:0}: Error finding container f072941e62cba0ff1359e4e2ffa8404087542593598932489e2854a037378544: Status 404 returned error can't find the container with id f072941e62cba0ff1359e4e2ffa8404087542593598932489e2854a037378544
Jul 28 01:26:52.197592 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.197563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pl7jv"]
Jul 28 01:26:52.205536 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:52.205493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83c9cad_df78_4a37_9ac8_b7c87f513fe0.slice/crio-380ee349b51164153eff65bc2237665728731d5d285ff41cf563bda176a06430 WatchSource:0}: Error finding container 380ee349b51164153eff65bc2237665728731d5d285ff41cf563bda176a06430: Status 404 returned error can't find the container with id 380ee349b51164153eff65bc2237665728731d5d285ff41cf563bda176a06430
Jul 28 01:26:52.226467 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.226443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlr62"]
Jul 28 01:26:52.229624 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:52.229600    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8e282e_73f2_4f26_9761_ecaad95c14b6.slice/crio-1bb3888ab94ffb5f85f67e78fe0111e04560da18b05439f48a4614fc4ea781e0 WatchSource:0}: Error finding container 1bb3888ab94ffb5f85f67e78fe0111e04560da18b05439f48a4614fc4ea781e0: Status 404 returned error can't find the container with id 1bb3888ab94ffb5f85f67e78fe0111e04560da18b05439f48a4614fc4ea781e0
Jul 28 01:26:52.732543 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.732452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-x2fg5" event={"ID":"c3652c76-ed8f-461d-8241-a9778f207c58","Type":"ContainerStarted","Data":"0ff0e6cfef06061c0979fd54b51dfceeaa395920f98a3e883cda278949dfc41c"}
Jul 28 01:26:52.734881 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.734803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlr62" event={"ID":"8c8e282e-73f2-4f26-9761-ecaad95c14b6","Type":"ContainerStarted","Data":"1bb3888ab94ffb5f85f67e78fe0111e04560da18b05439f48a4614fc4ea781e0"}
Jul 28 01:26:52.737196 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.737138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6vxb" event={"ID":"c628472c-dbbd-47e1-a86e-f0b9a5306da6","Type":"ContainerStarted","Data":"f072941e62cba0ff1359e4e2ffa8404087542593598932489e2854a037378544"}
Jul 28 01:26:52.739757 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.739688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pl7jv" event={"ID":"a83c9cad-df78-4a37-9ac8-b7c87f513fe0","Type":"ContainerStarted","Data":"380ee349b51164153eff65bc2237665728731d5d285ff41cf563bda176a06430"}
Jul 28 01:26:52.743074 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.742411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq" event={"ID":"444364e4-db25-4d41-a654-57607913a7d7","Type":"ContainerStarted","Data":"a38abb67f8d78d3f04899291b23353889a821f902529ef722c4e0bdb4b8b630c"}
Jul 28 01:26:52.743074 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.742453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq" event={"ID":"444364e4-db25-4d41-a654-57607913a7d7","Type":"ContainerStarted","Data":"bee72e8215be048b392a50806d4566202db41fe025fdeeb2cee09e116fe62b8d"}
Jul 28 01:26:52.743074 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.742825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:26:52.765347 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:52.764138    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq" podStartSLOduration=1.7641114949999999 podStartE2EDuration="1.764111495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:52.759003168 +0000 UTC m=+56.883103650" watchObservedRunningTime="2026-07-28 01:26:52.764111495 +0000 UTC m=+56.888211968"
Jul 28 01:26:54.299230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.299038    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:26:54.319205 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.318468    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:26:54.319205 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.318592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.322076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.321067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 01:26:54.322076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.321361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 01:26:54.322076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.321654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 01:26:54.322076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.321860    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 01:26:54.322076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.322049    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ttt4j\""
Jul 28 01:26:54.322851 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.322221    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 01:26:54.506681 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.506850 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.506850 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th2vc\" (UniqueName: \"kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.506850 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.507048 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.507048 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.506895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.607982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.608034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.608057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.608130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.608174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.608792 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.608204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th2vc\" (UniqueName: \"kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.609323 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.609279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.609877 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.609798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.610227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.610183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.612381 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.612363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.616595 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.616498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th2vc\" (UniqueName: \"kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.624437 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.624410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config\") pod \"console-5668f74f94-smflw\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") " pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.631734 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.631509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:26:54.994203 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:54.994175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:26:55.913680 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:55.913630    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26a24a8_9833_4099_b0e9_3705ba8d14ec.slice/crio-534f0de4475cd53153333a82644e2950bc572b25a5f45595dafed89d66ac5094 WatchSource:0}: Error finding container 534f0de4475cd53153333a82644e2950bc572b25a5f45595dafed89d66ac5094: Status 404 returned error can't find the container with id 534f0de4475cd53153333a82644e2950bc572b25a5f45595dafed89d66ac5094
Jul 28 01:26:56.758172 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:56.758128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668f74f94-smflw" event={"ID":"a26a24a8-9833-4099-b0e9-3705ba8d14ec","Type":"ContainerStarted","Data":"534f0de4475cd53153333a82644e2950bc572b25a5f45595dafed89d66ac5094"}
Jul 28 01:26:57.668120 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:57.668083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxgq6"
Jul 28 01:26:58.125939 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.125903    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"]
Jul 28 01:26:58.152891 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.152861    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"]
Jul 28 01:26:58.153078 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.152990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:58.155209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.155187    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b44rs\""
Jul 28 01:26:58.155390 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.155187    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 01:26:58.342720 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.342680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6tlz2\" (UID: \"b104c575-aec9-4aec-b4cf-14495844c88a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:58.444810 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.444159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6tlz2\" (UID: \"b104c575-aec9-4aec-b4cf-14495844c88a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:58.444810 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:58.444308    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:26:58.444810 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:26:58.444394    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates podName:b104c575-aec9-4aec-b4cf-14495844c88a nodeName:}" failed. No retries permitted until 2026-07-28 01:26:58.944375336 +0000 UTC m=+63.068475798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-6tlz2" (UID: "b104c575-aec9-4aec-b4cf-14495844c88a") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:26:58.949118 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.948583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6tlz2\" (UID: \"b104c575-aec9-4aec-b4cf-14495844c88a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:58.959678 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:58.954415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b104c575-aec9-4aec-b4cf-14495844c88a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-6tlz2\" (UID: \"b104c575-aec9-4aec-b4cf-14495844c88a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:59.064832 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.064462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:26:59.325428 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.324940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"]
Jul 28 01:26:59.331898 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:26:59.331731    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb104c575_aec9_4aec_b4cf_14495844c88a.slice/crio-52e70ee6e54c58604590b329ae00df7b3fddccdc26a4ded813ff50db5ceba82b WatchSource:0}: Error finding container 52e70ee6e54c58604590b329ae00df7b3fddccdc26a4ded813ff50db5ceba82b: Status 404 returned error can't find the container with id 52e70ee6e54c58604590b329ae00df7b3fddccdc26a4ded813ff50db5ceba82b
Jul 28 01:26:59.771629 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.771593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2" event={"ID":"b104c575-aec9-4aec-b4cf-14495844c88a","Type":"ContainerStarted","Data":"52e70ee6e54c58604590b329ae00df7b3fddccdc26a4ded813ff50db5ceba82b"}
Jul 28 01:26:59.773406 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.773348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlr62" event={"ID":"8c8e282e-73f2-4f26-9761-ecaad95c14b6","Type":"ContainerStarted","Data":"cb01dded92e0aae325289af21b5d1df3435bcb471e736cb9e37ab206631e7347"}
Jul 28 01:26:59.776118 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.776090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6vxb" event={"ID":"c628472c-dbbd-47e1-a86e-f0b9a5306da6","Type":"ContainerStarted","Data":"dca59416956c6f72d4f6fc155c6a3cfa17461e91653915b65dda0b660fa43ece"}
Jul 28 01:26:59.776227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.776142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6vxb" event={"ID":"c628472c-dbbd-47e1-a86e-f0b9a5306da6","Type":"ContainerStarted","Data":"7e84e37f0e1ca79c5b501af656ed8b80f211e29ea987ae2092ad839acb5f03c7"}
Jul 28 01:26:59.776504 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.776482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:26:59.780361 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.780336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pl7jv" event={"ID":"a83c9cad-df78-4a37-9ac8-b7c87f513fe0","Type":"ContainerStarted","Data":"3bcf7150d77e7387bddf8e94f440e05d8c9d35d1e3d874586a89c331f45fcdd4"}
Jul 28 01:26:59.795873 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.795816    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r6vxb" podStartSLOduration=1.828060418 podStartE2EDuration="8.795796237s" totalImagesPullingTime="6.967735819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:59.794587252 +0000 UTC m=+63.918687728" watchObservedRunningTime="2026-07-28 01:26:59.795796237 +0000 UTC m=+63.919896719"
Jul 28 01:26:59.808953 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:26:59.808896    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pl7jv" podStartSLOduration=1.85960446 podStartE2EDuration="8.808882317s" totalImagesPullingTime="6.949277857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:59.807779016 +0000 UTC m=+63.931879498" watchObservedRunningTime="2026-07-28 01:26:59.808882317 +0000 UTC m=+63.932982802"
Jul 28 01:27:01.067207 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.067166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:27:01.067601 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.067278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:27:01.069853 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.069783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:27:01.070209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.070187    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:27:01.080175 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.079960    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:27:01.085221 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.085163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb74f5be-8c87-4755-aab0-219dad056c51-metrics-certs\") pod \"network-metrics-daemon-vcp24\" (UID: \"bb74f5be-8c87-4755-aab0-219dad056c51\") " pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:27:01.092300 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.092234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkr9z\" (UniqueName: \"kubernetes.io/projected/415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f-kube-api-access-nkr9z\") pod \"network-check-target-97l5d\" (UID: \"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f\") " pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:27:01.168329 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.168258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:27:01.170526 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.170501    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:27:01.181989 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.181944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be464c89-fd49-42df-87c7-04f020c01aa1-original-pull-secret\") pod \"global-pull-secret-syncer-b6s48\" (UID: \"be464c89-fd49-42df-87c7-04f020c01aa1\") " pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:27:01.305892 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.305861    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ptgdn\""
Jul 28 01:27:01.308463 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.308433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b6s48"
Jul 28 01:27:01.314347 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.314323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vcp24"
Jul 28 01:27:01.315020 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.315000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xpqm\""
Jul 28 01:27:01.323574 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:01.323523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:27:02.881320 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.881285    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:27:02.901555 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.901522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:27:02.901730 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.901628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.908739 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.908716    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 01:27:02.978988 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.978945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979125 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.978999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979125 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.979093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.979154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979209 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.979195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmm9b\" (UniqueName: \"kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979287 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.979236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:02.979287 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:02.979263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.080492 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.080451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.080694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.080512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.080694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.080546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.080694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.080583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.080694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.080610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.081183 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.081152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmm9b\" (UniqueName: \"kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.081308 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.081214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.081308 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.081270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.081308 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.081270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.081465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.081342    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.082258 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.082196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.084562 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.084541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.084662 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.084549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.089528 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.089505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmm9b\" (UniqueName: \"kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b\") pod \"console-7b6d8bb6bc-tpdwt\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") " pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:03.214223 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:03.214135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:09.787440 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:09.787405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r6vxb"
Jul 28 01:27:11.376389 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.376285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b6s48"]
Jul 28 01:27:11.466622 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.466458    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97l5d"]
Jul 28 01:27:11.478644 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:11.478594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415654d7_ed86_4eb1_8d2e_3cf3aef8bb8f.slice/crio-ddff4430fbfa89324ad3897d4674c215a92200790aa260bea8ad448d15247aa4 WatchSource:0}: Error finding container ddff4430fbfa89324ad3897d4674c215a92200790aa260bea8ad448d15247aa4: Status 404 returned error can't find the container with id ddff4430fbfa89324ad3897d4674c215a92200790aa260bea8ad448d15247aa4
Jul 28 01:27:11.487068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.486703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vcp24"]
Jul 28 01:27:11.490896 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:11.490868    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb74f5be_8c87_4755_aab0_219dad056c51.slice/crio-b62261c16e0592a06cda0b73dcd316d8f8daedce2f95c19567fc25f635e9351d WatchSource:0}: Error finding container b62261c16e0592a06cda0b73dcd316d8f8daedce2f95c19567fc25f635e9351d: Status 404 returned error can't find the container with id b62261c16e0592a06cda0b73dcd316d8f8daedce2f95c19567fc25f635e9351d
Jul 28 01:27:11.524477 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.524448    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:27:11.527921 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:11.527894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3dda74_a054_4d9a_b311_3468869a3185.slice/crio-250cbe391c870889e41c930a339596fe49cd28df3a32cfefabeee635a481bd8e WatchSource:0}: Error finding container 250cbe391c870889e41c930a339596fe49cd28df3a32cfefabeee635a481bd8e: Status 404 returned error can't find the container with id 250cbe391c870889e41c930a339596fe49cd28df3a32cfefabeee635a481bd8e
Jul 28 01:27:11.821630 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.821595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668f74f94-smflw" event={"ID":"a26a24a8-9833-4099-b0e9-3705ba8d14ec","Type":"ContainerStarted","Data":"9c1f067d717a75838fbd487d8f52277cb75a12d358df84592886ac8d7e641c62"}
Jul 28 01:27:11.827060 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.826953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97l5d" event={"ID":"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f","Type":"ContainerStarted","Data":"ddff4430fbfa89324ad3897d4674c215a92200790aa260bea8ad448d15247aa4"}
Jul 28 01:27:11.830186 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.830115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vcp24" event={"ID":"bb74f5be-8c87-4755-aab0-219dad056c51","Type":"ContainerStarted","Data":"b62261c16e0592a06cda0b73dcd316d8f8daedce2f95c19567fc25f635e9351d"}
Jul 28 01:27:11.836361 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.836280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b6s48" event={"ID":"be464c89-fd49-42df-87c7-04f020c01aa1","Type":"ContainerStarted","Data":"e9c6dbbdc59af9ca946622fd96ead7c965305367a305d5ee8cf057d33766f555"}
Jul 28 01:27:11.839201 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.839143    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5668f74f94-smflw" podStartSLOduration=9.841642662 podStartE2EDuration="17.839125121s" totalImagesPullingTime="7.997482459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:11.837878708 +0000 UTC m=+75.961979189" watchObservedRunningTime="2026-07-28 01:27:11.839125121 +0000 UTC m=+75.963225603"
Jul 28 01:27:11.841753 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.841306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-x2fg5" event={"ID":"c3652c76-ed8f-461d-8241-a9778f207c58","Type":"ContainerStarted","Data":"2da4dc71b0e9107d149755afbef4b63ec44583ebc178ab176ad4f7fbbdb733ff"}
Jul 28 01:27:11.841753 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.841654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:27:11.844196 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.843846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2" event={"ID":"b104c575-aec9-4aec-b4cf-14495844c88a","Type":"ContainerStarted","Data":"5ea852d1544121c6af22a06dcb21405eb084856c3747b175bb72d9383bde7b73"}
Jul 28 01:27:11.844196 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.844181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:27:11.848805 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.848740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlr62" event={"ID":"8c8e282e-73f2-4f26-9761-ecaad95c14b6","Type":"ContainerStarted","Data":"69f62105a09a4df9ea2c84663445587686b9fcb993efccb6c2772856448c0bd4"}
Jul 28 01:27:11.850702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.850659    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2"
Jul 28 01:27:11.851861 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.851321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d8bb6bc-tpdwt" event={"ID":"ea3dda74-a054-4d9a-b311-3468869a3185","Type":"ContainerStarted","Data":"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"}
Jul 28 01:27:11.851861 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.851359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d8bb6bc-tpdwt" event={"ID":"ea3dda74-a054-4d9a-b311-3468869a3185","Type":"ContainerStarted","Data":"250cbe391c870889e41c930a339596fe49cd28df3a32cfefabeee635a481bd8e"}
Jul 28 01:27:11.852079 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.852063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-x2fg5"
Jul 28 01:27:11.861298 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.861252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-x2fg5" podStartSLOduration=1.638251745 podStartE2EDuration="20.861232426s" totalImagesPullingTime="19.222980681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:11.859875017 +0000 UTC m=+75.983975498" watchObservedRunningTime="2026-07-28 01:27:11.861232426 +0000 UTC m=+75.985332913"
Jul 28 01:27:11.890524 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.890239    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6d8bb6bc-tpdwt" podStartSLOduration=9.890219185 podStartE2EDuration="9.890219185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:11.888759902 +0000 UTC m=+76.012860385" watchObservedRunningTime="2026-07-28 01:27:11.890219185 +0000 UTC m=+76.014319666"
Jul 28 01:27:11.932514 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:11.931319    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-6tlz2" podStartSLOduration=2.053069552 podStartE2EDuration="13.931299222s" totalImagesPullingTime="11.87822967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:11.930696978 +0000 UTC m=+76.054797459" watchObservedRunningTime="2026-07-28 01:27:11.931299222 +0000 UTC m=+76.055399704"
Jul 28 01:27:12.187866 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.186610    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dqln4"]
Jul 28 01:27:12.193569 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.193544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.197068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.195709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 01:27:12.197068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.196219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j4s6g\""
Jul 28 01:27:12.197068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.196466    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 01:27:12.197068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.196657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 01:27:12.197068 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.196875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 01:27:12.197421 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.197271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 01:27:12.201707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.201634    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dqln4"]
Jul 28 01:27:12.268906 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.268642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.268906 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.268704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2pts\" (UniqueName: \"kubernetes.io/projected/e6518348-bd28-4af7-af5e-011b69f04523-kube-api-access-p2pts\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.268906 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.268735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.268906 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.268760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6518348-bd28-4af7-af5e-011b69f04523-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.370426 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.370271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2pts\" (UniqueName: \"kubernetes.io/projected/e6518348-bd28-4af7-af5e-011b69f04523-kube-api-access-p2pts\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.370426 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.370330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.370426 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.370357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6518348-bd28-4af7-af5e-011b69f04523-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.371344 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.370920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.371703 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.371678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6518348-bd28-4af7-af5e-011b69f04523-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.378693 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.378642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2pts\" (UniqueName: \"kubernetes.io/projected/e6518348-bd28-4af7-af5e-011b69f04523-kube-api-access-p2pts\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.387707 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.387670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.390237 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.390210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6518348-bd28-4af7-af5e-011b69f04523-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-dqln4\" (UID: \"e6518348-bd28-4af7-af5e-011b69f04523\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.507803 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.507530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4"
Jul 28 01:27:12.766508 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.766423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-dqln4"]
Jul 28 01:27:12.774355 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:12.774321    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6518348_bd28_4af7_af5e_011b69f04523.slice/crio-8ab7c418cdbe155fc79e7b805fcd1fbf57e44b1d37bb1dffeb6eb9e90d7a7fbe WatchSource:0}: Error finding container 8ab7c418cdbe155fc79e7b805fcd1fbf57e44b1d37bb1dffeb6eb9e90d7a7fbe: Status 404 returned error can't find the container with id 8ab7c418cdbe155fc79e7b805fcd1fbf57e44b1d37bb1dffeb6eb9e90d7a7fbe
Jul 28 01:27:12.859902 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:12.859843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4" event={"ID":"e6518348-bd28-4af7-af5e-011b69f04523","Type":"ContainerStarted","Data":"8ab7c418cdbe155fc79e7b805fcd1fbf57e44b1d37bb1dffeb6eb9e90d7a7fbe"}
Jul 28 01:27:13.215340 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.215153    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:13.215340 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.215249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:13.223705 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.223464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:13.756904 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.756874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d587bf6b4-zppmq"
Jul 28 01:27:13.869938 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.869909    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:27:13.918901 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:13.918811    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:27:14.632724 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:14.632598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:27:14.875092 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:14.875047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vcp24" event={"ID":"bb74f5be-8c87-4755-aab0-219dad056c51","Type":"ContainerStarted","Data":"2d29e4a9284ac5cf2a541c536476c0491b0c242a5244955254cdfdb7fb377f87"}
Jul 28 01:27:14.875546 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:14.875117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vcp24" event={"ID":"bb74f5be-8c87-4755-aab0-219dad056c51","Type":"ContainerStarted","Data":"e219eb99bcfa02e505b3087c28c27b0c2ed27b190f11e990e77186c5f822b99a"}
Jul 28 01:27:14.895414 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:14.895309    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vcp24" podStartSLOduration=75.47206245 podStartE2EDuration="1m17.895285322s" totalImagesPullingTime="2.423222872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:14.8927164 +0000 UTC m=+79.016816884" watchObservedRunningTime="2026-07-28 01:27:14.895285322 +0000 UTC m=+79.019385808"
Jul 28 01:27:21.910154 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.910118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97l5d" event={"ID":"415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f","Type":"ContainerStarted","Data":"3895bb2a43c1eadc244ec6638f8efa443689369ba48964c5c7bdc47f8bbfc48b"}
Jul 28 01:27:21.910642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.910241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:27:21.912253 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.912218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4" event={"ID":"e6518348-bd28-4af7-af5e-011b69f04523","Type":"ContainerStarted","Data":"1fa6e9c088049caf5d508bfab3a2214e73a784e5ff6e92a31f7e9a17ed4be219"}
Jul 28 01:27:21.914901 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.914879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlr62" event={"ID":"8c8e282e-73f2-4f26-9761-ecaad95c14b6","Type":"ContainerStarted","Data":"c1b8f90636fed0f9e4c3eb848873b5a94b367d23e904ba693df480cd9c7a1a5b"}
Jul 28 01:27:21.923682 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.923550    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-97l5d" podStartSLOduration=74.711709657 podStartE2EDuration="1m24.923529663s" totalImagesPullingTime="10.211820006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.923454419 +0000 UTC m=+86.047554901" watchObservedRunningTime="2026-07-28 01:27:21.923529663 +0000 UTC m=+86.047630148"
Jul 28 01:27:21.939486 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:21.939432    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tlr62" podStartSLOduration=1.7441586949999999 podStartE2EDuration="30.939412931s" totalImagesPullingTime="29.195254236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.938945814 +0000 UTC m=+86.063046295" watchObservedRunningTime="2026-07-28 01:27:21.939412931 +0000 UTC m=+86.063513414"
Jul 28 01:27:22.919576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:22.919542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b6s48" event={"ID":"be464c89-fd49-42df-87c7-04f020c01aa1","Type":"ContainerStarted","Data":"89c7ac9816d0edaf30d02fd55424e5d9eb6b28b8ea737fc608c4d497f9ae53a7"}
Jul 28 01:27:22.921399 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:22.921379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4" event={"ID":"e6518348-bd28-4af7-af5e-011b69f04523","Type":"ContainerStarted","Data":"7ba465cb90f25d0beb41815daec986d28c676f4b3028bd5021c9aa5343b48fdf"}
Jul 28 01:27:22.933444 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:22.933390    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b6s48" podStartSLOduration=75.615351915 podStartE2EDuration="1m25.933372242s" totalImagesPullingTime="10.318020327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:22.932664587 +0000 UTC m=+87.056765069" watchObservedRunningTime="2026-07-28 01:27:22.933372242 +0000 UTC m=+87.057472725"
Jul 28 01:27:22.948246 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:22.948181    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-dqln4" podStartSLOduration=2.030668068 podStartE2EDuration="10.948162182s" totalImagesPullingTime="8.917494114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:22.946849599 +0000 UTC m=+87.070950084" watchObservedRunningTime="2026-07-28 01:27:22.948162182 +0000 UTC m=+87.072262663"
Jul 28 01:27:24.493866 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.493833    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"]
Jul 28 01:27:24.547997 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.547950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"]
Jul 28 01:27:24.547997 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.548005    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"]
Jul 28 01:27:24.548200 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.548074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.550071 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.550043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 01:27:24.550071 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.550043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 01:27:24.550230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.550054    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mbmj8\""
Jul 28 01:27:24.563359 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.563334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b8bxt"]
Jul 28 01:27:24.563468 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.563447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.568380 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.568341    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 01:27:24.568959 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.568943    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fmt8p\""
Jul 28 01:27:24.569060 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.569021    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 01:27:24.570575 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.570558    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 01:27:24.585787 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.585769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"]
Jul 28 01:27:24.585887 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.585866    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.589214 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.589198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 01:27:24.589884 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.589867    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 01:27:24.590104 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.590089    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 01:27:24.590173 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.590111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-469rd\""
Jul 28 01:27:24.683264 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683418 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp28d\" (UniqueName: \"kubernetes.io/projected/ed801cc1-f8cc-41fe-8315-af86f4202a70-kube-api-access-dp28d\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683418 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683418 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c60de02-6554-4b09-89ac-18a47bc67b16-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.683418 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnlq\" (UniqueName: \"kubernetes.io/projected/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-api-access-jhnlq\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683418 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-sys\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-textfile\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-root\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-metrics-client-ca\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683573 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.683830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr9bn\" (UniqueName: \"kubernetes.io/projected/1c60de02-6554-4b09-89ac-18a47bc67b16-kube-api-access-fr9bn\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.683830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.683830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-wtmp\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.683830 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.683683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-tls\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.784647 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.784647 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr9bn\" (UniqueName: \"kubernetes.io/projected/1c60de02-6554-4b09-89ac-18a47bc67b16-kube-api-access-fr9bn\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.784647 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.784886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-wtmp\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.784886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-tls\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.784886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.784886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp28d\" (UniqueName: \"kubernetes.io/projected/ed801cc1-f8cc-41fe-8315-af86f4202a70-kube-api-access-dp28d\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.784886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.784878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-wtmp\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c60de02-6554-4b09-89ac-18a47bc67b16-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnlq\" (UniqueName: \"kubernetes.io/projected/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-api-access-jhnlq\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-sys\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-textfile\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785226    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-root\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-metrics-client-ca\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785445 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.785818 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.785818 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-root\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.785818 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.785788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-textfile\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.786075 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.786051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.786277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.786256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed801cc1-f8cc-41fe-8315-af86f4202a70-sys\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.786560 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.786498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c60de02-6554-4b09-89ac-18a47bc67b16-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.787016 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.786993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed801cc1-f8cc-41fe-8315-af86f4202a70-metrics-client-ca\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.787873 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.787699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-tls\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.788035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.788016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed801cc1-f8cc-41fe-8315-af86f4202a70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.788343 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.788302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.788493 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.788476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.788581 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.788562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.788876 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.788861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c60de02-6554-4b09-89ac-18a47bc67b16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.792338 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.792306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr9bn\" (UniqueName: \"kubernetes.io/projected/1c60de02-6554-4b09-89ac-18a47bc67b16-kube-api-access-fr9bn\") pod \"openshift-state-metrics-b8f49f5c6-ttck9\" (UID: \"1c60de02-6554-4b09-89ac-18a47bc67b16\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.792548 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.792527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp28d\" (UniqueName: \"kubernetes.io/projected/ed801cc1-f8cc-41fe-8315-af86f4202a70-kube-api-access-dp28d\") pod \"node-exporter-b8bxt\" (UID: \"ed801cc1-f8cc-41fe-8315-af86f4202a70\") " pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.793138 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.793122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnlq\" (UniqueName: \"kubernetes.io/projected/f7c7a897-8186-4c34-8f4e-d8790c6b2e0a-kube-api-access-jhnlq\") pod \"kube-state-metrics-56d9f944b4-zfrsc\" (UID: \"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.856620 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.856584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"
Jul 28 01:27:24.871671 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.871642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"
Jul 28 01:27:24.893834 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:24.893812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8bxt"
Jul 28 01:27:24.955206 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:24.955169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded801cc1_f8cc_41fe_8315_af86f4202a70.slice/crio-4c4283f935070df674ee76bab5c6d2b3a79c4090c883732914e4e0ae7469dbfe WatchSource:0}: Error finding container 4c4283f935070df674ee76bab5c6d2b3a79c4090c883732914e4e0ae7469dbfe: Status 404 returned error can't find the container with id 4c4283f935070df674ee76bab5c6d2b3a79c4090c883732914e4e0ae7469dbfe
Jul 28 01:27:25.036642 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.036617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9"]
Jul 28 01:27:25.038924 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:25.038881    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c60de02_6554_4b09_89ac_18a47bc67b16.slice/crio-2135d303f77da275e49a493a8a8a5e6b3393ddd3efb8cf18cc1a9ebf092af190 WatchSource:0}: Error finding container 2135d303f77da275e49a493a8a8a5e6b3393ddd3efb8cf18cc1a9ebf092af190: Status 404 returned error can't find the container with id 2135d303f77da275e49a493a8a8a5e6b3393ddd3efb8cf18cc1a9ebf092af190
Jul 28 01:27:25.053018 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.052993    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc"]
Jul 28 01:27:25.055812 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:25.055786    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c7a897_8186_4c34_8f4e_d8790c6b2e0a.slice/crio-f096ab497660cd97e60bf52a753d5f0accfb2dc26617b8734901e52e7bf97ea7 WatchSource:0}: Error finding container f096ab497660cd97e60bf52a753d5f0accfb2dc26617b8734901e52e7bf97ea7: Status 404 returned error can't find the container with id f096ab497660cd97e60bf52a753d5f0accfb2dc26617b8734901e52e7bf97ea7
Jul 28 01:27:25.571489 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.571413    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:27:25.600274 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.600226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:27:25.600498 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.600430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.604261 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.603844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 01:27:25.604261 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.603893    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tnwlb\""
Jul 28 01:27:25.604261 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604159    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604443    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604403    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 01:27:25.604632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 01:27:25.604910 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.604830    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 01:27:25.693758 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.693758 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-web-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-config-out\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-config-volume\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.693962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694070 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t229w\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-kube-api-access-t229w\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694364 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694364 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.694364 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.694184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795061 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-web-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-config-out\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-config-volume\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t229w\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-kube-api-access-t229w\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.795864 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.795840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.796237 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.796212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.796351 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:27:25.796248    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 01:27:25.796351 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:27:25.796315    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls podName:60bfe38f-dc37-475a-97c1-de123da3a69a nodeName:}" failed. No retries permitted until 2026-07-28 01:27:26.296296112 +0000 UTC m=+90.420396591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "60bfe38f-dc37-475a-97c1-de123da3a69a") : secret "alertmanager-main-tls" not found
Jul 28 01:27:25.796502 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.796473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bfe38f-dc37-475a-97c1-de123da3a69a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.798832 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.798788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.800846 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.800819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.801041 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.801013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.803352 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.803309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.803491 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.803470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.803777 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.803754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-config-volume\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.803894 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.803879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bfe38f-dc37-475a-97c1-de123da3a69a-config-out\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.805005 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.804982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-web-config\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.807315 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.807272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t229w\" (UniqueName: \"kubernetes.io/projected/60bfe38f-dc37-475a-97c1-de123da3a69a-kube-api-access-t229w\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:25.934750 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.934428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc" event={"ID":"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a","Type":"ContainerStarted","Data":"f096ab497660cd97e60bf52a753d5f0accfb2dc26617b8734901e52e7bf97ea7"}
Jul 28 01:27:25.935761 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.935732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8bxt" event={"ID":"ed801cc1-f8cc-41fe-8315-af86f4202a70","Type":"ContainerStarted","Data":"4c4283f935070df674ee76bab5c6d2b3a79c4090c883732914e4e0ae7469dbfe"}
Jul 28 01:27:25.937681 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.937653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9" event={"ID":"1c60de02-6554-4b09-89ac-18a47bc67b16","Type":"ContainerStarted","Data":"19ecf381388c67adf1472ebe8ba319c5859a43f179c0ba7dc3b133d02d4561aa"}
Jul 28 01:27:25.937793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.937704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9" event={"ID":"1c60de02-6554-4b09-89ac-18a47bc67b16","Type":"ContainerStarted","Data":"3f58c24a4f6e75a73426b84377f0409f6c6a92a1b6b92f3d61853fc666cc77d2"}
Jul 28 01:27:25.937793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:25.937727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9" event={"ID":"1c60de02-6554-4b09-89ac-18a47bc67b16","Type":"ContainerStarted","Data":"2135d303f77da275e49a493a8a8a5e6b3393ddd3efb8cf18cc1a9ebf092af190"}
Jul 28 01:27:26.299533 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.299490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:26.302320 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.302294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/60bfe38f-dc37-475a-97c1-de123da3a69a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"60bfe38f-dc37-475a-97c1-de123da3a69a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:26.511162 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.511125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:27:26.806608 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.806584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:27:26.808196 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:26.808169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bfe38f_dc37_475a_97c1_de123da3a69a.slice/crio-9709e2e591d614f902876167b31168209619295fe67b725ec4d694ffae91a96a WatchSource:0}: Error finding container 9709e2e591d614f902876167b31168209619295fe67b725ec4d694ffae91a96a: Status 404 returned error can't find the container with id 9709e2e591d614f902876167b31168209619295fe67b725ec4d694ffae91a96a
Jul 28 01:27:26.942804 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.942745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8bxt" event={"ID":"ed801cc1-f8cc-41fe-8315-af86f4202a70","Type":"ContainerStarted","Data":"d35788e4890da6c274072a5c650445a7ae16feba2dcade1b8aa328335ec05200"}
Jul 28 01:27:26.943937 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:26.943916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"9709e2e591d614f902876167b31168209619295fe67b725ec4d694ffae91a96a"}
Jul 28 01:27:27.510991 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.510891    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"]
Jul 28 01:27:27.527406 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.527379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"]
Jul 28 01:27:27.527566 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.527500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529373    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529567    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c06tfp7jhdjk9\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529639    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 01:27:27.529760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.529474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t5wfw\""
Jul 28 01:27:27.611554 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611682 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9kf\" (UniqueName: \"kubernetes.io/projected/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-kube-api-access-2f9kf\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611682 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-metrics-client-ca\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611757 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611875 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.611875 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.611859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-grpc-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.712691 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.712843 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9kf\" (UniqueName: \"kubernetes.io/projected/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-kube-api-access-2f9kf\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.712843 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-metrics-client-ca\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.712843 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.713035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.713035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.713035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.713035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.712928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-grpc-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.716962 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.716908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-metrics-client-ca\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.718184 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.718157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.718727 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.718687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-grpc-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.718823 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.718723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.719992 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.719805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.720520 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.720479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.721242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.721180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-secret-thanos-querier-tls\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.724661 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.724636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9kf\" (UniqueName: \"kubernetes.io/projected/e22de437-58c7-4a0d-aefe-8ad70ea5eaa2-kube-api-access-2f9kf\") pod \"thanos-querier-b46c44d5f-8gqhc\" (UID: \"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2\") " pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.839165 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.839078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:27.950501 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.950465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc" event={"ID":"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a","Type":"ContainerStarted","Data":"da1f0c6f6d503a770f7d222f980236685754e47f09394525c8a4ed92c3cc18d7"}
Jul 28 01:27:27.950669 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.950536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc" event={"ID":"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a","Type":"ContainerStarted","Data":"822b041b90f36fa72817e725ebf424ee12d23db66c9e8b7279c581ce9cc5e38a"}
Jul 28 01:27:27.950669 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.950563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc" event={"ID":"f7c7a897-8186-4c34-8f4e-d8790c6b2e0a","Type":"ContainerStarted","Data":"6fcf13c2079e01eea0a4cd63c75980abb331fa4489cfc91329affc0ebbc4cb66"}
Jul 28 01:27:27.952044 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.952010    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed801cc1-f8cc-41fe-8315-af86f4202a70" containerID="d35788e4890da6c274072a5c650445a7ae16feba2dcade1b8aa328335ec05200" exitCode=0
Jul 28 01:27:27.952174 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.952095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8bxt" event={"ID":"ed801cc1-f8cc-41fe-8315-af86f4202a70","Type":"ContainerDied","Data":"d35788e4890da6c274072a5c650445a7ae16feba2dcade1b8aa328335ec05200"}
Jul 28 01:27:27.954954 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.954404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9" event={"ID":"1c60de02-6554-4b09-89ac-18a47bc67b16","Type":"ContainerStarted","Data":"3df5fbc240dd06b00d53b347f5b9085d3da0b1223c89e44743d6f5ad4b87b237"}
Jul 28 01:27:27.970266 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.970217    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zfrsc" podStartSLOduration=1.778720625 podStartE2EDuration="3.970199463s" totalImagesPullingTime="2.191478838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:27.968683015 +0000 UTC m=+92.092783498" watchObservedRunningTime="2026-07-28 01:27:27.970199463 +0000 UTC m=+92.094299947"
Jul 28 01:27:27.987506 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:27.985857    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ttck9" podStartSLOduration=1.687167431 podStartE2EDuration="3.9858362s" totalImagesPullingTime="2.298668769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:27.984763554 +0000 UTC m=+92.108864028" watchObservedRunningTime="2026-07-28 01:27:27.9858362 +0000 UTC m=+92.109936682"
Jul 28 01:27:28.014199 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.014175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"]
Jul 28 01:27:28.312437 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:28.312383    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22de437_58c7_4a0d_aefe_8ad70ea5eaa2.slice/crio-f967ce1ee06366cad4ba7a8195ea7138d6df7ccb54700fe9f5dead59fa3b3e6b WatchSource:0}: Error finding container f967ce1ee06366cad4ba7a8195ea7138d6df7ccb54700fe9f5dead59fa3b3e6b: Status 404 returned error can't find the container with id f967ce1ee06366cad4ba7a8195ea7138d6df7ccb54700fe9f5dead59fa3b3e6b
Jul 28 01:27:28.923878 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.923801    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f8d968c67-st5jn"]
Jul 28 01:27:28.941609 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.941568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f8d968c67-st5jn"]
Jul 28 01:27:28.941784 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.941711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:28.945489 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 01:27:28.945489 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945478    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ftt7r\""
Jul 28 01:27:28.945721 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945483    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 01:27:28.945784 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945739    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 01:27:28.945837 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945794    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a90lu9dp3977e\""
Jul 28 01:27:28.945837 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.945819    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 01:27:28.960868 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.960838    2579 generic.go:356] "Generic (PLEG): container finished" podID="60bfe38f-dc37-475a-97c1-de123da3a69a" containerID="586797dca6c9aaa3203f50792eb840afe716f90b218865fd88110813f432696e" exitCode=0
Jul 28 01:27:28.961062 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.960916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerDied","Data":"586797dca6c9aaa3203f50792eb840afe716f90b218865fd88110813f432696e"}
Jul 28 01:27:28.962290 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.962256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"f967ce1ee06366cad4ba7a8195ea7138d6df7ccb54700fe9f5dead59fa3b3e6b"}
Jul 28 01:27:28.965696 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.965667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8bxt" event={"ID":"ed801cc1-f8cc-41fe-8315-af86f4202a70","Type":"ContainerStarted","Data":"b52558274479453d44dd3e3bfa5c7a8cb3833f7ea9954432a4088ada1063e0b7"}
Jul 28 01:27:28.965807 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:28.965727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8bxt" event={"ID":"ed801cc1-f8cc-41fe-8315-af86f4202a70","Type":"ContainerStarted","Data":"538e8c670d1cbac71be51d0beb85c556e9fa5f886515c259d23f195ec435f236"}
Jul 28 01:27:29.005321 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.005252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b8bxt" podStartSLOduration=3.184161163 podStartE2EDuration="5.005230078s" totalImagesPullingTime="1.720653656s" totalInitContainerRuntime="100.415259ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:29.003662323 +0000 UTC m=+93.127762806" watchObservedRunningTime="2026-07-28 01:27:29.005230078 +0000 UTC m=+93.129330560"
Jul 28 01:27:29.025897 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.025728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s788c\" (UniqueName: \"kubernetes.io/projected/88a08103-a650-4789-860f-5f4a12e50cf5-kube-api-access-s788c\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.025897 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.025888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-client-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.026186 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.026063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-tls\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.026257 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.026234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-metrics-server-audit-profiles\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.026325 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.026278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-client-certs\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.026325 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.026304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88a08103-a650-4789-860f-5f4a12e50cf5-audit-log\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.026428 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.026334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127390 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s788c\" (UniqueName: \"kubernetes.io/projected/88a08103-a650-4789-860f-5f4a12e50cf5-kube-api-access-s788c\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127390 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-client-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-tls\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-metrics-server-audit-profiles\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-client-certs\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88a08103-a650-4789-860f-5f4a12e50cf5-audit-log\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.127664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.127656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.128372 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.128333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88a08103-a650-4789-860f-5f4a12e50cf5-audit-log\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.128511 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.128490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.128773 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.128740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88a08103-a650-4789-860f-5f4a12e50cf5-metrics-server-audit-profiles\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.130825 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.130802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-client-certs\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.131120 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.131097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-client-ca-bundle\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.131363 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.131341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88a08103-a650-4789-860f-5f4a12e50cf5-secret-metrics-server-tls\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.135413 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.135395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s788c\" (UniqueName: \"kubernetes.io/projected/88a08103-a650-4789-860f-5f4a12e50cf5-kube-api-access-s788c\") pod \"metrics-server-f8d968c67-st5jn\" (UID: \"88a08103-a650-4789-860f-5f4a12e50cf5\") " pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.255151 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.255112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:29.344260 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.344089    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"]
Jul 28 01:27:29.361342 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.361306    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:27:29.362587 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.362563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.364774 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.364749    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7xqxp\""
Jul 28 01:27:29.365089 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.365065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 01:27:29.380406 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.379959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"]
Jul 28 01:27:29.380406 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.380014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:27:29.380406 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.380113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.430500 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.430467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjbz5\" (UniqueName: \"kubernetes.io/projected/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-kube-api-access-hjbz5\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.430682 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.430515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.439817 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.439749    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f8d968c67-st5jn"]
Jul 28 01:27:29.444820 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:29.444787    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a08103_a650_4789_860f_5f4a12e50cf5.slice/crio-069b4a8f24f1c292f1b43877de8b459bbb45cc6aefac09c10725dba16cbd3231 WatchSource:0}: Error finding container 069b4a8f24f1c292f1b43877de8b459bbb45cc6aefac09c10725dba16cbd3231: Status 404 returned error can't find the container with id 069b4a8f24f1c292f1b43877de8b459bbb45cc6aefac09c10725dba16cbd3231
Jul 28 01:27:29.531082 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531082 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckrf\" (UniqueName: \"kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjbz5\" (UniqueName: \"kubernetes.io/projected/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-kube-api-access-hjbz5\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.531277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.531277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531277 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531464 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.531464 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.531351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.534033 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.534010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.538324 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.538302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjbz5\" (UniqueName: \"kubernetes.io/projected/748cebb1-9ad7-4bf0-8e65-37f6def60d8f-kube-api-access-hjbz5\") pod \"monitoring-plugin-68b7fc9574-gdpv2\" (UID: \"748cebb1-9ad7-4bf0-8e65-37f6def60d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.632809 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.632956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckrf\" (UniqueName: \"kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633014 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.633007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633820 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.633774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.633944 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.633906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.634158 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.634132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.634266 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.634236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.636045 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.636028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.637683 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.637659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.641872 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.641850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckrf\" (UniqueName: \"kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf\") pod \"console-6fd48945d9-bpznr\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") " pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.675472 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.675441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:29.693735 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.693705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:29.749709 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.748021    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-678dfc8957-7cgkf"]
Jul 28 01:27:29.766593 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.766560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-678dfc8957-7cgkf"]
Jul 28 01:27:29.766776 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.766731    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.769634 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.769611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 01:27:29.769819 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.769797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 01:27:29.770043 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.770024    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 01:27:29.770632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.770610    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 01:27:29.770872 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.770844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4f6nk\""
Jul 28 01:27:29.771052 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.771036    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 01:27:29.777064 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.777034    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 01:27:29.835099 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-metrics-client-ca\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835099 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6tg\" (UniqueName: \"kubernetes.io/projected/ad9e1ad7-70c1-4524-89ab-76498c5953dc-kube-api-access-nf6tg\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835099 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835407 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-serving-certs-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835407 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835407 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835407 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-federate-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.835407 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.835261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.935947 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.935914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-federate-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-metrics-client-ca\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6tg\" (UniqueName: \"kubernetes.io/projected/ad9e1ad7-70c1-4524-89ab-76498c5953dc-kube-api-access-nf6tg\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.936475 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.936272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-serving-certs-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.937185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.937028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-metrics-client-ca\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.937185 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.937096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-serving-certs-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.937350 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.937320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.939197 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.939157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-federate-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.939308 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.939293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.939359 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.939291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-secret-telemeter-client\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.939500 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.939476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad9e1ad7-70c1-4524-89ab-76498c5953dc-telemeter-client-tls\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.944027 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.944010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6tg\" (UniqueName: \"kubernetes.io/projected/ad9e1ad7-70c1-4524-89ab-76498c5953dc-kube-api-access-nf6tg\") pod \"telemeter-client-678dfc8957-7cgkf\" (UID: \"ad9e1ad7-70c1-4524-89ab-76498c5953dc\") " pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:29.971716 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:29.971681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn" event={"ID":"88a08103-a650-4789-860f-5f4a12e50cf5","Type":"ContainerStarted","Data":"069b4a8f24f1c292f1b43877de8b459bbb45cc6aefac09c10725dba16cbd3231"}
Jul 28 01:27:30.081133 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.081091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf"
Jul 28 01:27:30.771008 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.768677    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:30.789417 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.789381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:30.789600 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.789571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.791413 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.791392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 01:27:30.792742 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.792719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 01:27:30.792861 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.792768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 01:27:30.792999 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.792730    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 01:27:30.794057 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.793282    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fw6k8\""
Jul 28 01:27:30.794057 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.793480    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 01:27:30.794057 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.793668    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 01:27:30.794271 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.794080    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 01:27:30.794271 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.794235    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 01:27:30.794376 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.794365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 01:27:30.795071 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.794493    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8rrf9cdhh9dql\""
Jul 28 01:27:30.795071 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.794885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 01:27:30.795507 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.795491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 01:27:30.796673 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.796653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 01:27:30.798061 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.798041    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 01:27:30.803500 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.800729    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 01:27:30.946572 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.946943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6gx\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-kube-api-access-9n6gx\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:30.947531 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:30.947192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.047901 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.047809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.047901 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.047864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.047901 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.047891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6gx\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-kube-api-access-9n6gx\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048455 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.048796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.048620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.049910 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.049877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.051416 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.050364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.051816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.052400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.052589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.052625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.052762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.052870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.053584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.053821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.054021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.054038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.054447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.054636 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.054586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.055280 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.054992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.055697 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.055674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.056213 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.056190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.056879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.056859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.057035 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.057019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6gx\" (UniqueName: \"kubernetes.io/projected/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-kube-api-access-9n6gx\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.057780 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.057756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e4cde11-4dd5-4df5-be5f-ebe878ba9c17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.108172 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.108130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:31.291163 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.291016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:27:31.321253 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.321168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"]
Jul 28 01:27:31.359019 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.358957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-678dfc8957-7cgkf"]
Jul 28 01:27:31.704832 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:31.704736    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9e1ad7_70c1_4524_89ab_76498c5953dc.slice/crio-ae67857a17a03659f966dd580a48dc0a2b173212b3fac07b81bf39be6f7c6b30 WatchSource:0}: Error finding container ae67857a17a03659f966dd580a48dc0a2b173212b3fac07b81bf39be6f7c6b30: Status 404 returned error can't find the container with id ae67857a17a03659f966dd580a48dc0a2b173212b3fac07b81bf39be6f7c6b30
Jul 28 01:27:31.705525 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:31.705473    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09082478_798e_484d_bec7_8950f44f12a4.slice/crio-cbaa85aa9de01b9918c2ed4bf183f2c0bd32672f0b7d4de332d3fc5e8b328717 WatchSource:0}: Error finding container cbaa85aa9de01b9918c2ed4bf183f2c0bd32672f0b7d4de332d3fc5e8b328717: Status 404 returned error can't find the container with id cbaa85aa9de01b9918c2ed4bf183f2c0bd32672f0b7d4de332d3fc5e8b328717
Jul 28 01:27:31.706530 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:31.706363    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748cebb1_9ad7_4bf0_8e65_37f6def60d8f.slice/crio-a4dab83d898ff3c5791301e248926246f44d7a52b125d92caddeddd3be345db8 WatchSource:0}: Error finding container a4dab83d898ff3c5791301e248926246f44d7a52b125d92caddeddd3be345db8: Status 404 returned error can't find the container with id a4dab83d898ff3c5791301e248926246f44d7a52b125d92caddeddd3be345db8
Jul 28 01:27:31.855533 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.855501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:31.861076 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:27:31.861040    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4cde11_4dd5_4df5_be5f_ebe878ba9c17.slice/crio-98965451c10a3eb75b528fa7ec7cb7ccd6bcb4d6dff4901247dbfa5f7310b20a WatchSource:0}: Error finding container 98965451c10a3eb75b528fa7ec7cb7ccd6bcb4d6dff4901247dbfa5f7310b20a: Status 404 returned error can't find the container with id 98965451c10a3eb75b528fa7ec7cb7ccd6bcb4d6dff4901247dbfa5f7310b20a
Jul 28 01:27:31.984462 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.984430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2" event={"ID":"748cebb1-9ad7-4bf0-8e65-37f6def60d8f","Type":"ContainerStarted","Data":"a4dab83d898ff3c5791301e248926246f44d7a52b125d92caddeddd3be345db8"}
Jul 28 01:27:31.985926 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.985903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd48945d9-bpznr" event={"ID":"09082478-798e-484d-bec7-8950f44f12a4","Type":"ContainerStarted","Data":"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"}
Jul 28 01:27:31.986094 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.985947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd48945d9-bpznr" event={"ID":"09082478-798e-484d-bec7-8950f44f12a4","Type":"ContainerStarted","Data":"cbaa85aa9de01b9918c2ed4bf183f2c0bd32672f0b7d4de332d3fc5e8b328717"}
Jul 28 01:27:31.987596 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.987572    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"7e4e38172b7890033fa9577a71c778b66896997b81e33976b5fcaed73d116780"}
Jul 28 01:27:31.987676 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.987622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"1a0e982c4490ca0b0cc88325ec7802484d5ba620a17229a1f8b7c0291609dc21"}
Jul 28 01:27:31.988750 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.988718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"98965451c10a3eb75b528fa7ec7cb7ccd6bcb4d6dff4901247dbfa5f7310b20a"}
Jul 28 01:27:31.989870 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.989850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf" event={"ID":"ad9e1ad7-70c1-4524-89ab-76498c5953dc","Type":"ContainerStarted","Data":"ae67857a17a03659f966dd580a48dc0a2b173212b3fac07b81bf39be6f7c6b30"}
Jul 28 01:27:31.991858 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.991841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"c7e244191110c399d0e2feab171ff5990d17a7f4cbd918f7ee93781e4b6afee8"}
Jul 28 01:27:31.991935 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:31.991891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"0c5a85b291d93e2c81915f7c3c436039ea0347e5c32676b294d68be9950f1948"}
Jul 28 01:27:32.002989 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:32.002931    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd48945d9-bpznr" podStartSLOduration=3.002919102 podStartE2EDuration="3.002919102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:32.001100017 +0000 UTC m=+96.125200500" watchObservedRunningTime="2026-07-28 01:27:32.002919102 +0000 UTC m=+96.127019577"
Jul 28 01:27:33.001463 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.001408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"4c79a51db22e27871e028a94c4c3d3e370198b474d9ee88794dfd367ba8e0add"}
Jul 28 01:27:33.003454 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.003413    2579 generic.go:356] "Generic (PLEG): container finished" podID="6e4cde11-4dd5-4df5-be5f-ebe878ba9c17" containerID="02f7ee0a822fbac0dc7d24e4345fc31e9d94cade28a86e568b1c4fb237d1d2aa" exitCode=0
Jul 28 01:27:33.003583 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.003508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerDied","Data":"02f7ee0a822fbac0dc7d24e4345fc31e9d94cade28a86e568b1c4fb237d1d2aa"}
Jul 28 01:27:33.005879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.005828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn" event={"ID":"88a08103-a650-4789-860f-5f4a12e50cf5","Type":"ContainerStarted","Data":"6b4b835838722d7ca20aaf6087c7d3e12204a1ab2cbf4dbc1e8d2d4c155e4b0c"}
Jul 28 01:27:33.009772 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.009746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"83667a94771c42cc3ddc01b1fcb960b6730e95ccf54d7cf01b2586eb45e99b22"}
Jul 28 01:27:33.009879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.009818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"896dc04d4a6bf3aa0150df3ca702022a422be5fd6cab9d283a0e65cda2a59a64"}
Jul 28 01:27:33.009879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.009863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"f47e532df33e8771b14069c87a05ef1c26854223a830f76f4068ce52fafc54dc"}
Jul 28 01:27:33.047454 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:33.047397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn" podStartSLOduration=2.468522967 podStartE2EDuration="5.047375434s" totalImagesPullingTime="2.578852467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:33.046123954 +0000 UTC m=+97.170224434" watchObservedRunningTime="2026-07-28 01:27:33.047375434 +0000 UTC m=+97.171475917"
Jul 28 01:27:35.022222 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.022125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2" event={"ID":"748cebb1-9ad7-4bf0-8e65-37f6def60d8f","Type":"ContainerStarted","Data":"11da5e1aac6e1dab3005c947f12b647c7b57571f751e124f5bb2e2962f1ef41c"}
Jul 28 01:27:35.022703 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.022542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:35.027226 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.027198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"ca3af7390f36fc6460f177d17cfa61f19ef4528418f142752f3df62b86cbe6e5"}
Jul 28 01:27:35.027354 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.027278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"410dbd2291b3e1be67f0c05296a7a68ff8418bb25ebee283115cc0cde983e157"}
Jul 28 01:27:35.029051 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.029025    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2"
Jul 28 01:27:35.031004 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.030872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf" event={"ID":"ad9e1ad7-70c1-4524-89ab-76498c5953dc","Type":"ContainerStarted","Data":"3932e8e86b70c5821123579dd1bad678c2374beffc687f6441fe6c3397a5192f"}
Jul 28 01:27:35.031004 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.030930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf" event={"ID":"ad9e1ad7-70c1-4524-89ab-76498c5953dc","Type":"ContainerStarted","Data":"96f5f83d5f7656b34f1536c15126b9893cfaa3318850b2c25a86a08669993c2a"}
Jul 28 01:27:35.035311 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.035283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"60bfe38f-dc37-475a-97c1-de123da3a69a","Type":"ContainerStarted","Data":"e8ced1ffacbdaa74e5540723179c1a420df6a2f931480913e08e060b3b712102"}
Jul 28 01:27:35.038350 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.037986    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpv2" podStartSLOduration=3.158839816 podStartE2EDuration="6.03794785s" totalImagesPullingTime="2.879108034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:35.036018499 +0000 UTC m=+99.160118981" watchObservedRunningTime="2026-07-28 01:27:35.03794785 +0000 UTC m=+99.162048332"
Jul 28 01:27:35.076641 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:35.076586    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.840776619 podStartE2EDuration="10.076567754s" totalImagesPullingTime="6.218966038s" totalInitContainerRuntime="16.825097ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:35.075378817 +0000 UTC m=+99.199479334" watchObservedRunningTime="2026-07-28 01:27:35.076567754 +0000 UTC m=+99.200668278"
Jul 28 01:27:36.050016 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.049891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" event={"ID":"e22de437-58c7-4a0d-aefe-8ad70ea5eaa2","Type":"ContainerStarted","Data":"99ce21fae7dbeca91fb7d7e757ea1b6636e24ef0b0e45547582161e8d0a6f1f4"}
Jul 28 01:27:36.050580 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.050359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:36.055945 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.055913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf" event={"ID":"ad9e1ad7-70c1-4524-89ab-76498c5953dc","Type":"ContainerStarted","Data":"6d1a5caa116b0537b44baac4a3d5f1d99c64438ae24f618dbf17fd244496fc55"}
Jul 28 01:27:36.057694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.057673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc"
Jul 28 01:27:36.072774 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.072210    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b46c44d5f-8gqhc" podStartSLOduration=3.847498099 podStartE2EDuration="9.072188013s" totalImagesPullingTime="5.224689914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:36.070180159 +0000 UTC m=+100.194280641" watchObservedRunningTime="2026-07-28 01:27:36.072188013 +0000 UTC m=+100.196288494"
Jul 28 01:27:36.108604 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:36.108538    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-678dfc8957-7cgkf" podStartSLOduration=4.228907962 podStartE2EDuration="7.108517108s" totalImagesPullingTime="2.879609146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:36.106427402 +0000 UTC m=+100.230527919" watchObservedRunningTime="2026-07-28 01:27:36.108517108 +0000 UTC m=+100.232617590"
Jul 28 01:27:37.310223 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:37.310186    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:27:37.938931 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:37.938902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pl7jv_a83c9cad-df78-4a37-9ac8-b7c87f513fe0/serve-healthcheck-canary/0.log"
Jul 28 01:27:38.070054 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:38.070026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"e5a8878e5e9cf3b8e937f79bb203922b2bffbd5a77a90b3d6721b138d3024317"}
Jul 28 01:27:38.958647 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:38.958595    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5668f74f94-smflw" podUID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" containerName="console" containerID="cri-o://9c1f067d717a75838fbd487d8f52277cb75a12d358df84592886ac8d7e641c62" gracePeriod=15
Jul 28 01:27:39.076131 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.076094    2579 generic.go:356] "Generic (PLEG): container finished" podID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" containerID="9c1f067d717a75838fbd487d8f52277cb75a12d358df84592886ac8d7e641c62" exitCode=0
Jul 28 01:27:39.076285 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.076164    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668f74f94-smflw" event={"ID":"a26a24a8-9833-4099-b0e9-3705ba8d14ec","Type":"ContainerDied","Data":"9c1f067d717a75838fbd487d8f52277cb75a12d358df84592886ac8d7e641c62"}
Jul 28 01:27:39.079436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.079414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"4fe7550a086015130841af9e45a4dd686c34a22cca9ff5958e4fb0fa25809d2a"}
Jul 28 01:27:39.079602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.079463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"7a923a31e8866a7d356b7f5bc84f36c6be90d3b17ce34e6f55548e6d939d77c0"}
Jul 28 01:27:39.079602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.079488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"ad3a1fbbd4f5a68a834bb1931f56e37c21cbd537bcd11cb5aeea34cb27b4e2f4"}
Jul 28 01:27:39.079602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.079511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"8e98626f2485a1516c24072908df6b1d138838c436c8c23ffc3083724e629df7"}
Jul 28 01:27:39.079602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.079533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e4cde11-4dd5-4df5-be5f-ebe878ba9c17","Type":"ContainerStarted","Data":"d0a0ba913285297ebde8793f46a4deeedb0b9ad3387d86af55cf71f3543a4914"}
Jul 28 01:27:39.133440 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.133377    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.255826016 podStartE2EDuration="9.133352105s" totalImagesPullingTime="4.871007602s" totalInitContainerRuntime="6.518487ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:39.132392635 +0000 UTC m=+103.256493117" watchObservedRunningTime="2026-07-28 01:27:39.133352105 +0000 UTC m=+103.257452587"
Jul 28 01:27:39.235142 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.235119    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:27:39.340879 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.340844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341103 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.340940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341103 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341028    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th2vc\" (UniqueName: \"kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341103 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341063    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341103 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341085    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341302 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config\") pod \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\" (UID: \"a26a24a8-9833-4099-b0e9-3705ba8d14ec\") "
Jul 28 01:27:39.341440 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341413    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:27:39.341563 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:27:39.341563 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.341515    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config" (OuterVolumeSpecName: "console-config") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:27:39.343569 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.343546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:27:39.343742 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.343720    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:27:39.343783 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.343747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc" (OuterVolumeSpecName: "kube-api-access-th2vc") pod "a26a24a8-9833-4099-b0e9-3705ba8d14ec" (UID: "a26a24a8-9833-4099-b0e9-3705ba8d14ec"). InnerVolumeSpecName "kube-api-access-th2vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:27:39.442466 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442437    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-service-ca\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.442466 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442464    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th2vc\" (UniqueName: \"kubernetes.io/projected/a26a24a8-9833-4099-b0e9-3705ba8d14ec-kube-api-access-th2vc\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.442466 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442474    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-oauth-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.442674 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442484    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.442674 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442493    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-oauth-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.442674 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.442500    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a26a24a8-9833-4099-b0e9-3705ba8d14ec-console-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.694807 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:39.694718    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:27:40.087722 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.087694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668f74f94-smflw"
Jul 28 01:27:40.088313 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.087925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668f74f94-smflw" event={"ID":"a26a24a8-9833-4099-b0e9-3705ba8d14ec","Type":"ContainerDied","Data":"534f0de4475cd53153333a82644e2950bc572b25a5f45595dafed89d66ac5094"}
Jul 28 01:27:40.088313 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.088016    2579 scope.go:117] "RemoveContainer" containerID="9c1f067d717a75838fbd487d8f52277cb75a12d358df84592886ac8d7e641c62"
Jul 28 01:27:40.108180 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.108150    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:27:40.111937 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.111914    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5668f74f94-smflw"]
Jul 28 01:27:40.399871 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:40.399774    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" path="/var/lib/kubelet/pods/a26a24a8-9833-4099-b0e9-3705ba8d14ec/volumes"
Jul 28 01:27:41.108517 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:41.108478    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:48.438159 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:48.438125    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:27:49.256072 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:49.256038    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:49.256240 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:49.256127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:27:52.924401 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:27:52.924366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-97l5d"
Jul 28 01:28:02.331743 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:02.331681    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fd48945d9-bpznr" podUID="09082478-798e-484d-bec7-8950f44f12a4" containerName="console" containerID="cri-o://8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9" gracePeriod=15
Jul 28 01:28:03.113178 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.113148    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:28:03.172937 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.172891    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173093 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.172986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173145 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173089    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173145 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173213 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173179    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173289 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckrf\" (UniqueName: \"kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173347 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert\") pod \"09082478-798e-484d-bec7-8950f44f12a4\" (UID: \"09082478-798e-484d-bec7-8950f44f12a4\") "
Jul 28 01:28:03.173454 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173352    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config" (OuterVolumeSpecName: "console-config") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:03.173454 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173444    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:03.173630 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:03.173702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173648    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-console-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.173702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173644    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:03.173702 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.173660    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-oauth-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.175230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.175208    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:03.175558 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.175531    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:03.175623 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.175564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf" (OuterVolumeSpecName: "kube-api-access-8ckrf") pod "09082478-798e-484d-bec7-8950f44f12a4" (UID: "09082478-798e-484d-bec7-8950f44f12a4"). InnerVolumeSpecName "kube-api-access-8ckrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:03.201939 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.201909    2579 generic.go:356] "Generic (PLEG): container finished" podID="09082478-798e-484d-bec7-8950f44f12a4" containerID="8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9" exitCode=0
Jul 28 01:28:03.202092 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.201950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd48945d9-bpznr" event={"ID":"09082478-798e-484d-bec7-8950f44f12a4","Type":"ContainerDied","Data":"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"}
Jul 28 01:28:03.202092 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.202019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd48945d9-bpznr" event={"ID":"09082478-798e-484d-bec7-8950f44f12a4","Type":"ContainerDied","Data":"cbaa85aa9de01b9918c2ed4bf183f2c0bd32672f0b7d4de332d3fc5e8b328717"}
Jul 28 01:28:03.202092 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.202039    2579 scope.go:117] "RemoveContainer" containerID="8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"
Jul 28 01:28:03.202092 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.201955    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd48945d9-bpznr"
Jul 28 01:28:03.211220 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.211204    2579 scope.go:117] "RemoveContainer" containerID="8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"
Jul 28 01:28:03.211479 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:28:03.211457    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9\": container with ID starting with 8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9 not found: ID does not exist" containerID="8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"
Jul 28 01:28:03.211522 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.211486    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9"} err="failed to get container status \"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9\": rpc error: code = NotFound desc = could not find container \"8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9\": container with ID starting with 8a4d4ff166c3cfe1bdc91f2ad304299d301d313bfead8373cdd2b9be1b361de9 not found: ID does not exist"
Jul 28 01:28:03.226741 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.226712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:28:03.230577 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.230552    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd48945d9-bpznr"]
Jul 28 01:28:03.274476 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.274450    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-oauth-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.274476 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.274474    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-trusted-ca-bundle\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.274627 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.274486    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09082478-798e-484d-bec7-8950f44f12a4-service-ca\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.274627 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.274497    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckrf\" (UniqueName: \"kubernetes.io/projected/09082478-798e-484d-bec7-8950f44f12a4-kube-api-access-8ckrf\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:03.274627 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:03.274506    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09082478-798e-484d-bec7-8950f44f12a4-console-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:04.403499 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:04.399321    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09082478-798e-484d-bec7-8950f44f12a4" path="/var/lib/kubelet/pods/09082478-798e-484d-bec7-8950f44f12a4/volumes"
Jul 28 01:28:09.260913 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:09.260881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:28:09.264623 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:09.264603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f8d968c67-st5jn"
Jul 28 01:28:13.464227 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.464162    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b6d8bb6bc-tpdwt" podUID="ea3dda74-a054-4d9a-b311-3468869a3185" containerName="console" containerID="cri-o://5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2" gracePeriod=15
Jul 28 01:28:13.737283 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.737261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:28:13.871760 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871731    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.871924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871772    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.871924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.871924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871837    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.871924 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871857    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmm9b\" (UniqueName: \"kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.872140 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.871956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.872140 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.872007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert\") pod \"ea3dda74-a054-4d9a-b311-3468869a3185\" (UID: \"ea3dda74-a054-4d9a-b311-3468869a3185\") "
Jul 28 01:28:13.872290 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.872265    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:13.872381 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.872321    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config" (OuterVolumeSpecName: "console-config") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:13.872381 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.872228    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:13.872501 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.872376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:13.874370 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.874347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:13.874480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.874413    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b" (OuterVolumeSpecName: "kube-api-access-kmm9b") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "kube-api-access-kmm9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:13.874480 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.874415    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea3dda74-a054-4d9a-b311-3468869a3185" (UID: "ea3dda74-a054-4d9a-b311-3468869a3185"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:13.973007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.972952    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-oauth-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973000    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-serving-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973010    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-trusted-ca-bundle\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973228 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973019    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3dda74-a054-4d9a-b311-3468869a3185-console-oauth-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973228 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973028    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-console-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973228 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973036    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3dda74-a054-4d9a-b311-3468869a3185-service-ca\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:13.973228 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:13.973045    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmm9b\" (UniqueName: \"kubernetes.io/projected/ea3dda74-a054-4d9a-b311-3468869a3185-kube-api-access-kmm9b\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:28:14.254289 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.254255    2579 generic.go:356] "Generic (PLEG): container finished" podID="ea3dda74-a054-4d9a-b311-3468869a3185" containerID="5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2" exitCode=0
Jul 28 01:28:14.254465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.254300    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d8bb6bc-tpdwt"
Jul 28 01:28:14.254465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.254339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d8bb6bc-tpdwt" event={"ID":"ea3dda74-a054-4d9a-b311-3468869a3185","Type":"ContainerDied","Data":"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"}
Jul 28 01:28:14.254465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.254388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d8bb6bc-tpdwt" event={"ID":"ea3dda74-a054-4d9a-b311-3468869a3185","Type":"ContainerDied","Data":"250cbe391c870889e41c930a339596fe49cd28df3a32cfefabeee635a481bd8e"}
Jul 28 01:28:14.254465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.254409    2579 scope.go:117] "RemoveContainer" containerID="5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"
Jul 28 01:28:14.263632 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.263612    2579 scope.go:117] "RemoveContainer" containerID="5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"
Jul 28 01:28:14.263904 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:28:14.263885    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2\": container with ID starting with 5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2 not found: ID does not exist" containerID="5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"
Jul 28 01:28:14.263941 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.263913    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2"} err="failed to get container status \"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2\": rpc error: code = NotFound desc = could not find container \"5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2\": container with ID starting with 5ac857fcab13bf73c72856e39f384b85ccd43846d9cd536d00da88f4dc8082e2 not found: ID does not exist"
Jul 28 01:28:14.274388 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.274367    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:28:14.278417 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.278399    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6d8bb6bc-tpdwt"]
Jul 28 01:28:14.399451 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:14.399420    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3dda74-a054-4d9a-b311-3468869a3185" path="/var/lib/kubelet/pods/ea3dda74-a054-4d9a-b311-3468869a3185/volumes"
Jul 28 01:28:31.109271 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:31.109226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:28:31.129906 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:31.129880    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:28:31.344029 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:28:31.344002    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:30:56.288770 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:30:56.288743    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 01:33:51.961059 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-n6c4j"]
Jul 28 01:33:51.961628 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961558    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09082478-798e-484d-bec7-8950f44f12a4" containerName="console"
Jul 28 01:33:51.961628 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961577    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09082478-798e-484d-bec7-8950f44f12a4" containerName="console"
Jul 28 01:33:51.961628 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961594    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3dda74-a054-4d9a-b311-3468869a3185" containerName="console"
Jul 28 01:33:51.961628 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961602    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3dda74-a054-4d9a-b311-3468869a3185" containerName="console"
Jul 28 01:33:51.961628 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961624    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" containerName="console"
Jul 28 01:33:51.961883 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961634    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" containerName="console"
Jul 28 01:33:51.961883 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961715    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="09082478-798e-484d-bec7-8950f44f12a4" containerName="console"
Jul 28 01:33:51.961883 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961731    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea3dda74-a054-4d9a-b311-3468869a3185" containerName="console"
Jul 28 01:33:51.961883 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.961739    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26a24a8-9833-4099-b0e9-3705ba8d14ec" containerName="console"
Jul 28 01:33:51.963795 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.963774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-n6c4j"
Jul 28 01:33:51.965790 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.965767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 01:33:51.965790 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.965783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 28 01:33:51.965955 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.965798    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7vs28\""
Jul 28 01:33:51.965955 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.965806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 01:33:51.971827 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:51.971802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-n6c4j"]
Jul 28 01:33:52.039799 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.039763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsfhl\" (UniqueName: \"kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.040002 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.039823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.140635 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.140595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsfhl\" (UniqueName: \"kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.140811 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.140648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.141054 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.141038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.148521 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.148496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsfhl\" (UniqueName: \"kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl\") pod \"s3-init-n6c4j\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") " pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.287704 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.287658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-n6c4j"
Jul 28 01:33:52.414294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.414273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-n6c4j"]
Jul 28 01:33:52.417032 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:33:52.417003    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffc31fc5_ce42_4191_9304_d5edd31c90c3.slice/crio-c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce WatchSource:0}: Error finding container c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce: Status 404 returned error can't find the container with id c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce
Jul 28 01:33:52.419291 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.419273    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:33:52.676276 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:52.676195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerStarted","Data":"c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce"}
Jul 28 01:33:56.697518 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:56.697481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerStarted","Data":"6130278e72d58da925121604b6c14319b144deb18c39595bff840624ff5cd738"}
Jul 28 01:33:58.708222 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:58.708187    2579 generic.go:356] "Generic (PLEG): container finished" podID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerID="6130278e72d58da925121604b6c14319b144deb18c39595bff840624ff5cd738" exitCode=0
Jul 28 01:33:58.708605 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:33:58.708263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerDied","Data":"6130278e72d58da925121604b6c14319b144deb18c39595bff840624ff5cd738"}
Jul 28 01:34:03.301854 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:34:03.301830    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 28 01:34:03.738942 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:34:03.738902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerStarted","Data":"743a10affcd0d58a56bde7f24598f16c1906ec7f40ab9a4311b37720c991da95"}
Jul 28 01:34:03.754314 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:34:03.754266    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-n6c4j" podStartSLOduration=2.706541247 podStartE2EDuration="12.754251013s" totalImagesPullingTime="8.156619092s" totalInitContainerRuntime="1.891090674s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:33:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:03.752494623 +0000 UTC m=+487.876595107" watchObservedRunningTime="2026-07-28 01:34:03.754251013 +0000 UTC m=+487.878351496"
Jul 28 01:35:09.006117 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:09.006081    2579 generic.go:356] "Generic (PLEG): container finished" podID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerID="743a10affcd0d58a56bde7f24598f16c1906ec7f40ab9a4311b37720c991da95" exitCode=0
Jul 28 01:35:09.006528 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:09.006150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerDied","Data":"743a10affcd0d58a56bde7f24598f16c1906ec7f40ab9a4311b37720c991da95"}
Jul 28 01:35:10.143005 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.142960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-n6c4j"
Jul 28 01:35:10.258443 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.258402    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsfhl\" (UniqueName: \"kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl\") pod \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") "
Jul 28 01:35:10.258658 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.258452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache\") pod \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\" (UID: \"ffc31fc5-ce42-4191-9304-d5edd31c90c3\") "
Jul 28 01:35:10.260908 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.260840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl" (OuterVolumeSpecName: "kube-api-access-zsfhl") pod "ffc31fc5-ce42-4191-9304-d5edd31c90c3" (UID: "ffc31fc5-ce42-4191-9304-d5edd31c90c3"). InnerVolumeSpecName "kube-api-access-zsfhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:10.277575 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.277532    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "ffc31fc5-ce42-4191-9304-d5edd31c90c3" (UID: "ffc31fc5-ce42-4191-9304-d5edd31c90c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:10.359619 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.359575    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsfhl\" (UniqueName: \"kubernetes.io/projected/ffc31fc5-ce42-4191-9304-d5edd31c90c3-kube-api-access-zsfhl\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:10.359619 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:10.359610    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc31fc5-ce42-4191-9304-d5edd31c90c3-model-cache\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:11.016224 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:11.016197    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-n6c4j"
Jul 28 01:35:11.016401 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:11.016227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-n6c4j" event={"ID":"ffc31fc5-ce42-4191-9304-d5edd31c90c3","Type":"ContainerDied","Data":"c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce"}
Jul 28 01:35:11.016401 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:11.016258    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9cbd02d2cc73f5cb1f6173eb2679676babb096460d093c4fce3c65d8cb0d6ce"
Jul 28 01:35:18.581325 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-z8lld"]
Jul 28 01:35:18.581698 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581619    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerName="download-hf-model"
Jul 28 01:35:18.581698 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581630    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerName="download-hf-model"
Jul 28 01:35:18.581698 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581638    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerName="s3-init"
Jul 28 01:35:18.581698 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581643    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerName="s3-init"
Jul 28 01:35:18.581828 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.581703    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc31fc5-ce42-4191-9304-d5edd31c90c3" containerName="s3-init"
Jul 28 01:35:18.584664 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.584644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.586658 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.586641    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7vs28\""
Jul 28 01:35:18.586762 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.586660    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 01:35:18.587294 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.587278    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 28 01:35:18.587439 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.587293    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 01:35:18.590731 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.590710    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-z8lld"]
Jul 28 01:35:18.734946 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.734911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.734946 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.734946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxptw\" (UniqueName: \"kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.836230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.836129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.836230 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.836165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxptw\" (UniqueName: \"kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.836565 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.836541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.844366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.844333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxptw\" (UniqueName: \"kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw\") pod \"s3-tls-init-custom-z8lld\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") " pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:18.904777 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:18.904742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:19.033424 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:19.033358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-z8lld"]
Jul 28 01:35:19.036177 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:35:19.036152    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb661ae28_afa1_439a_9e11_81fd5ed391f2.slice/crio-fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b WatchSource:0}: Error finding container fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b: Status 404 returned error can't find the container with id fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b
Jul 28 01:35:19.052718 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:19.052682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerStarted","Data":"fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b"}
Jul 28 01:35:20.058553 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:20.058520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerStarted","Data":"12abb635072acee099ba2aa9ac91358440ed77046e10eabc841b2cd37d6552da"}
Jul 28 01:35:21.064031 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:21.063988    2579 generic.go:356] "Generic (PLEG): container finished" podID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerID="12abb635072acee099ba2aa9ac91358440ed77046e10eabc841b2cd37d6552da" exitCode=0
Jul 28 01:35:21.064426 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:21.064057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerDied","Data":"12abb635072acee099ba2aa9ac91358440ed77046e10eabc841b2cd37d6552da"}
Jul 28 01:35:22.070635 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:22.070599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerStarted","Data":"dd2ce3e5c7e1224ea2d938d697a35f4f840a4aad5252e213b100024ba4a02336"}
Jul 28 01:35:22.086923 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:22.086866    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-z8lld" podStartSLOduration=2.357264691 podStartE2EDuration="4.086850186s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.729585495s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:22.086022894 +0000 UTC m=+566.210123378" watchObservedRunningTime="2026-07-28 01:35:22.086850186 +0000 UTC m=+566.210950725"
Jul 28 01:35:27.095366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:27.095325    2579 generic.go:356] "Generic (PLEG): container finished" podID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerID="dd2ce3e5c7e1224ea2d938d697a35f4f840a4aad5252e213b100024ba4a02336" exitCode=0
Jul 28 01:35:27.095366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:27.095368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerDied","Data":"dd2ce3e5c7e1224ea2d938d697a35f4f840a4aad5252e213b100024ba4a02336"}
Jul 28 01:35:28.245688 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.245666    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:28.424184 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.424116    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache\") pod \"b661ae28-afa1-439a-9e11-81fd5ed391f2\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") "
Jul 28 01:35:28.424331 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.424199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxptw\" (UniqueName: \"kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw\") pod \"b661ae28-afa1-439a-9e11-81fd5ed391f2\" (UID: \"b661ae28-afa1-439a-9e11-81fd5ed391f2\") "
Jul 28 01:35:28.426312 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.426277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw" (OuterVolumeSpecName: "kube-api-access-jxptw") pod "b661ae28-afa1-439a-9e11-81fd5ed391f2" (UID: "b661ae28-afa1-439a-9e11-81fd5ed391f2"). InnerVolumeSpecName "kube-api-access-jxptw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:28.446979 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.446924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "b661ae28-afa1-439a-9e11-81fd5ed391f2" (UID: "b661ae28-afa1-439a-9e11-81fd5ed391f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:28.525599 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.525571    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b661ae28-afa1-439a-9e11-81fd5ed391f2-model-cache\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:28.525599 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:28.525595    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxptw\" (UniqueName: \"kubernetes.io/projected/b661ae28-afa1-439a-9e11-81fd5ed391f2-kube-api-access-jxptw\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:29.104980 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:29.104934    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-z8lld"
Jul 28 01:35:29.105150 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:29.104985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-z8lld" event={"ID":"b661ae28-afa1-439a-9e11-81fd5ed391f2","Type":"ContainerDied","Data":"fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b"}
Jul 28 01:35:29.105150 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:29.105018    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa71a7e4ad18e2b64371da0233732f1cd022cc28a85951ceb7b82ff5efe9cc1b"
Jul 28 01:35:31.907908 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.907873    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-xcq48"]
Jul 28 01:35:31.908337 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.908223    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerName="download-hf-model"
Jul 28 01:35:31.908337 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.908236    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerName="download-hf-model"
Jul 28 01:35:31.908337 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.908247    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerName="s3-tls-init-custom"
Jul 28 01:35:31.908337 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.908253    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerName="s3-tls-init-custom"
Jul 28 01:35:31.908337 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.908321    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b661ae28-afa1-439a-9e11-81fd5ed391f2" containerName="s3-tls-init-custom"
Jul 28 01:35:31.912180 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.912159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:31.914082 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.914059    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 01:35:31.914189 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.914137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Jul 28 01:35:31.914669 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.914654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 01:35:31.914743 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.914657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7vs28\""
Jul 28 01:35:31.917602 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.917582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-xcq48"]
Jul 28 01:35:31.953771 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.953745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmbf\" (UniqueName: \"kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:31.953890 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:31.953806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.054646 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.054606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.054819 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.054660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmbf\" (UniqueName: \"kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.055040 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.055023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.061783 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.061754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmbf\" (UniqueName: \"kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf\") pod \"s3-tls-init-serving-xcq48\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") " pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.231077 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.231053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:32.360366 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:32.360331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-xcq48"]
Jul 28 01:35:32.363429 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:35:32.363403    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeec2baa4_d4e6_4e9c_affd_b3bcf734657f.slice/crio-9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456 WatchSource:0}: Error finding container 9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456: Status 404 returned error can't find the container with id 9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456
Jul 28 01:35:33.123979 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:33.123933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerStarted","Data":"ea34ac104541716ce39dcc917bbd198e18f04d08e1543a5e66a746f5945d0ac0"}
Jul 28 01:35:33.124388 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:33.124001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerStarted","Data":"9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456"}
Jul 28 01:35:35.135902 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:35.135871    2579 generic.go:356] "Generic (PLEG): container finished" podID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerID="ea34ac104541716ce39dcc917bbd198e18f04d08e1543a5e66a746f5945d0ac0" exitCode=0
Jul 28 01:35:35.136352 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:35.135945    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerDied","Data":"ea34ac104541716ce39dcc917bbd198e18f04d08e1543a5e66a746f5945d0ac0"}
Jul 28 01:35:36.142390 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:36.142358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerStarted","Data":"4d94a7cb814ca3122ab30dec777d5685baea0fc2ab9af0f67a24a2e7ec309959"}
Jul 28 01:35:36.159398 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:36.159290    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-xcq48" podStartSLOduration=2.933528892 podStartE2EDuration="5.159267565s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.225738673s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:36.158994167 +0000 UTC m=+580.283094644" watchObservedRunningTime="2026-07-28 01:35:36.159267565 +0000 UTC m=+580.283368049"
Jul 28 01:35:43.175855 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:43.175820    2579 generic.go:356] "Generic (PLEG): container finished" podID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerID="4d94a7cb814ca3122ab30dec777d5685baea0fc2ab9af0f67a24a2e7ec309959" exitCode=0
Jul 28 01:35:43.176321 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:43.175898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerDied","Data":"4d94a7cb814ca3122ab30dec777d5685baea0fc2ab9af0f67a24a2e7ec309959"}
Jul 28 01:35:44.324701 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.324678    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:44.366436 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.366410    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqmbf\" (UniqueName: \"kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf\") pod \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") "
Jul 28 01:35:44.366616 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.366448    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache\") pod \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\" (UID: \"eec2baa4-d4e6-4e9c-affd-b3bcf734657f\") "
Jul 28 01:35:44.368688 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.368653    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf" (OuterVolumeSpecName: "kube-api-access-qqmbf") pod "eec2baa4-d4e6-4e9c-affd-b3bcf734657f" (UID: "eec2baa4-d4e6-4e9c-affd-b3bcf734657f"). InnerVolumeSpecName "kube-api-access-qqmbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:44.386065 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.386037    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache" (OuterVolumeSpecName: "model-cache") pod "eec2baa4-d4e6-4e9c-affd-b3bcf734657f" (UID: "eec2baa4-d4e6-4e9c-affd-b3bcf734657f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:44.467734 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.467653    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqmbf\" (UniqueName: \"kubernetes.io/projected/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-kube-api-access-qqmbf\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:44.467734 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:44.467679    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eec2baa4-d4e6-4e9c-affd-b3bcf734657f-model-cache\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:35:45.186686 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:45.186658    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-xcq48"
Jul 28 01:35:45.186686 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:45.186685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-xcq48" event={"ID":"eec2baa4-d4e6-4e9c-affd-b3bcf734657f","Type":"ContainerDied","Data":"9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456"}
Jul 28 01:35:45.186897 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:35:45.186726    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f12eb58ef87251bd98db90a312414c8cd353a6816520c803341e14eaf079456"
Jul 28 01:54:52.306088 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306047    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:54:52.306576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306386    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerName="s3-tls-init-serving"
Jul 28 01:54:52.306576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306397    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerName="s3-tls-init-serving"
Jul 28 01:54:52.306576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306419    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerName="download-hf-model"
Jul 28 01:54:52.306576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerName="download-hf-model"
Jul 28 01:54:52.306576 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.306483    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec2baa4-d4e6-4e9c-affd-b3bcf734657f" containerName="s3-tls-init-serving"
Jul 28 01:54:52.309515 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.309494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.311588 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.311564    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Jul 28 01:54:52.311728 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.311599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Jul 28 01:54:52.311796 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.311782    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:54:52.312076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.312059    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:54:52.312153 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.312066    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-96ksg\""
Jul 28 01:54:52.312153 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.312096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:54:52.312237 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.312097    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:54:52.318841 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.318815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:54:52.422323 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.422286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.422323 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.422331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dsk\" (UniqueName: \"kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.422561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.422354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.422561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.422429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.422561 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.422495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.523648 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.523607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.523831 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.523657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dsk\" (UniqueName: \"kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.523831 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.523692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.523831 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.523733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.523831 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.523800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.524226 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.524204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.524412 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.524394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.524484 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.524467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.526457 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.526435    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.532361 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.532334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dsk\" (UniqueName: \"kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk\") pod \"isvc-canary-promote-v2-predictor-86766c4958-rhq95\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.621872 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.621790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:54:52.758329 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:52.758306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:54:52.760725 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:54:52.760696    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55979039_de8d_4f80_9ef4_42b63aa542b5.slice/crio-9c70e0e79b10e88d2a9cdcec36e4582d4dc867dad1c9ed0a5dd77528990d6b53 WatchSource:0}: Error finding container 9c70e0e79b10e88d2a9cdcec36e4582d4dc867dad1c9ed0a5dd77528990d6b53: Status 404 returned error can't find the container with id 9c70e0e79b10e88d2a9cdcec36e4582d4dc867dad1c9ed0a5dd77528990d6b53
Jul 28 01:54:53.391856 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:53.391824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerStarted","Data":"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"}
Jul 28 01:54:53.392308 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:53.391882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerStarted","Data":"9c70e0e79b10e88d2a9cdcec36e4582d4dc867dad1c9ed0a5dd77528990d6b53"}
Jul 28 01:54:57.409560 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:57.409522    2579 generic.go:356] "Generic (PLEG): container finished" podID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerID="f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a" exitCode=0
Jul 28 01:54:57.409958 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:57.409599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerDied","Data":"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"}
Jul 28 01:54:57.410794 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:54:57.410761    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:55:11.497212 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:11.497170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerStarted","Data":"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"}
Jul 28 01:55:14.516706 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:14.516660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerStarted","Data":"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"}
Jul 28 01:55:14.517207 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:14.516777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:55:14.535940 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:14.535891    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podStartSLOduration=2.8550836950000003 podStartE2EDuration="22.535877753s" totalImagesPullingTime="15.979664964s" totalInitContainerRuntime="3.701129094s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:54:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:14.53423907 +0000 UTC m=+1758.658339553" watchObservedRunningTime="2026-07-28 01:55:14.535877753 +0000 UTC m=+1758.659978234"
Jul 28 01:55:15.522459 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:15.522428    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:55:15.523683 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:15.523647    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:55:16.527150 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:16.527103    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:55:21.531798 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:21.531767    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:55:21.532317 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:21.532291    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:55:31.532452 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:31.532410    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:55:41.533063 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:41.533021    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:55:51.532601 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:55:51.532520    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:01.532437 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:01.532389    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:11.533090 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:11.533046    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:21.532732 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:21.532688    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:24.393872 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:24.393826    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:34.398472 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:34.398442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:56:42.480800 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:42.480743    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:56:42.481305 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:42.481017    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" containerID="cri-o://e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a" gracePeriod=30
Jul 28 01:56:42.481305 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:42.481056    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kube-rbac-proxy" containerID="cri-o://a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1" gracePeriod=30
Jul 28 01:56:42.945614 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:42.945518    2579 generic.go:356] "Generic (PLEG): container finished" podID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerID="a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1" exitCode=2
Jul 28 01:56:42.945614 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:42.945600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerDied","Data":"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"}
Jul 28 01:56:44.393950 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:44.393902    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 28 01:56:46.528271 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:46.528226    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 28 01:56:47.627444 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.627414    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:56:47.760207 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert\") pod \"55979039-de8d-4f80-9ef4-42b63aa542b5\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") "
Jul 28 01:56:47.760383 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config\") pod \"55979039-de8d-4f80-9ef4-42b63aa542b5\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") "
Jul 28 01:56:47.760383 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760245    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5dsk\" (UniqueName: \"kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk\") pod \"55979039-de8d-4f80-9ef4-42b63aa542b5\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") "
Jul 28 01:56:47.760383 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls\") pod \"55979039-de8d-4f80-9ef4-42b63aa542b5\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") "
Jul 28 01:56:47.760540 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location\") pod \"55979039-de8d-4f80-9ef4-42b63aa542b5\" (UID: \"55979039-de8d-4f80-9ef4-42b63aa542b5\") "
Jul 28 01:56:47.760586 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "55979039-de8d-4f80-9ef4-42b63aa542b5" (UID: "55979039-de8d-4f80-9ef4-42b63aa542b5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:56:47.760630 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760581    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "55979039-de8d-4f80-9ef4-42b63aa542b5" (UID: "55979039-de8d-4f80-9ef4-42b63aa542b5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:56:47.760763 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760742    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "55979039-de8d-4f80-9ef4-42b63aa542b5" (UID: "55979039-de8d-4f80-9ef4-42b63aa542b5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:56:47.760861 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760847    2579 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/55979039-de8d-4f80-9ef4-42b63aa542b5-kserve-provision-location\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:56:47.760921 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760862    2579 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-cabundle-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:56:47.760921 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.760874    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:56:47.762694 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.762669    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "55979039-de8d-4f80-9ef4-42b63aa542b5" (UID: "55979039-de8d-4f80-9ef4-42b63aa542b5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:56:47.762778 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.762739    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk" (OuterVolumeSpecName: "kube-api-access-m5dsk") pod "55979039-de8d-4f80-9ef4-42b63aa542b5" (UID: "55979039-de8d-4f80-9ef4-42b63aa542b5"). InnerVolumeSpecName "kube-api-access-m5dsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:47.861391 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.861338    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5dsk\" (UniqueName: \"kubernetes.io/projected/55979039-de8d-4f80-9ef4-42b63aa542b5-kube-api-access-m5dsk\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:56:47.861391 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.861386    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/55979039-de8d-4f80-9ef4-42b63aa542b5-proxy-tls\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:56:47.973245 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.973211    2579 generic.go:356] "Generic (PLEG): container finished" podID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerID="e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a" exitCode=0
Jul 28 01:56:47.973411 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.973271    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"
Jul 28 01:56:47.973411 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.973286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerDied","Data":"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"}
Jul 28 01:56:47.973411 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.973353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95" event={"ID":"55979039-de8d-4f80-9ef4-42b63aa542b5","Type":"ContainerDied","Data":"9c70e0e79b10e88d2a9cdcec36e4582d4dc867dad1c9ed0a5dd77528990d6b53"}
Jul 28 01:56:47.973411 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.973381    2579 scope.go:117] "RemoveContainer" containerID="a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"
Jul 28 01:56:47.982128 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.982109    2579 scope.go:117] "RemoveContainer" containerID="e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"
Jul 28 01:56:47.989945 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.989924    2579 scope.go:117] "RemoveContainer" containerID="f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"
Jul 28 01:56:47.996258 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.996232    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:56:47.998439 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.998421    2579 scope.go:117] "RemoveContainer" containerID="a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"
Jul 28 01:56:47.998739 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:56:47.998719    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1\": container with ID starting with a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1 not found: ID does not exist" containerID="a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"
Jul 28 01:56:47.998802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.998747    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1"} err="failed to get container status \"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1\": rpc error: code = NotFound desc = could not find container \"a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1\": container with ID starting with a52f8d3f47a2187105bfbe41c2deeaa4f48c1eaf12628c36d9dae44fcc04cde1 not found: ID does not exist"
Jul 28 01:56:47.998802 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.998766    2579 scope.go:117] "RemoveContainer" containerID="e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"
Jul 28 01:56:47.999663 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:56:47.999634    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a\": container with ID starting with e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a not found: ID does not exist" containerID="e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"
Jul 28 01:56:47.999771 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.999691    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a"} err="failed to get container status \"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a\": rpc error: code = NotFound desc = could not find container \"e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a\": container with ID starting with e4c206fca970e2ad66a76b3ecf00a6969d9a91a4de1b5b674952ec8eb0b3292a not found: ID does not exist"
Jul 28 01:56:47.999771 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:47.999714    2579 scope.go:117] "RemoveContainer" containerID="f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"
Jul 28 01:56:48.000006 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:56:47.999961    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a\": container with ID starting with f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a not found: ID does not exist" containerID="f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"
Jul 28 01:56:48.000076 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:48.000015    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a"} err="failed to get container status \"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a\": rpc error: code = NotFound desc = could not find container \"f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a\": container with ID starting with f94bc9835dcd738b113cf4e9f3fc285a33541622ddc9a77aeed1b5d29d4cb56a not found: ID does not exist"
Jul 28 01:56:48.001203 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:48.001184    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-rhq95"]
Jul 28 01:56:48.399046 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:56:48.399009    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" path="/var/lib/kubelet/pods/55979039-de8d-4f80-9ef4-42b63aa542b5/volumes"
Jul 28 01:58:07.817755 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.817717    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818069    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818081    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818087    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kube-rbac-proxy"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818092    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kube-rbac-proxy"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818113    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="storage-initializer"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818119    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="storage-initializer"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818173    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kube-rbac-proxy"
Jul 28 01:58:07.818241 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.818181    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="55979039-de8d-4f80-9ef4-42b63aa542b5" containerName="kserve-container"
Jul 28 01:58:07.821304 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.821288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:07.824144 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.824118    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Jul 28 01:58:07.824891 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.824870    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:58:07.825013 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.824919    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Jul 28 01:58:07.825013 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.824874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:58:07.825013 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.824874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:58:07.825199 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.825039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-96ksg\""
Jul 28 01:58:07.825546 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.825527    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:58:07.837094 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.837071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:58:07.976886 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.976851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh947\" (UniqueName: \"kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:07.977143 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.976897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:07.977143 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.976928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:07.977143 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.977041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:07.977143 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:07.977084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.077832 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.077717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh947\" (UniqueName: \"kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.077832 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.077783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.077832 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.077814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.078165 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.077854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.078165 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.077873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.078321 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.078298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.078600 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.078583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.078635 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.078596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.080579 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.080553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.087956 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.087936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh947\" (UniqueName: \"kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.131793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.131753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:08.286812 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.286770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:58:08.294259 ip-10-0-138-153 kubenswrapper[2579]: W0728 01:58:08.294226    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba9d181_8472_44a1_bd7d_838a75b0611f.slice/crio-2e596c1ceb2f884e69a66bd1d44008d3d34cfb2c232174dfc2483c314d3fca8c WatchSource:0}: Error finding container 2e596c1ceb2f884e69a66bd1d44008d3d34cfb2c232174dfc2483c314d3fca8c: Status 404 returned error can't find the container with id 2e596c1ceb2f884e69a66bd1d44008d3d34cfb2c232174dfc2483c314d3fca8c
Jul 28 01:58:08.344029 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:08.343999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerStarted","Data":"2e596c1ceb2f884e69a66bd1d44008d3d34cfb2c232174dfc2483c314d3fca8c"}
Jul 28 01:58:09.350634 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:09.350596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerStarted","Data":"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"}
Jul 28 01:58:12.365242 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:12.365206    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerID="b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd" exitCode=0
Jul 28 01:58:12.365627 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:12.365274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerDied","Data":"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"}
Jul 28 01:58:13.374059 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.374019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerStarted","Data":"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"}
Jul 28 01:58:13.374478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.374084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerStarted","Data":"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"}
Jul 28 01:58:13.374478 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.374371    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:13.374551 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.374509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:13.375846 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.375822    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:13.398504 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:13.398436    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podStartSLOduration=2.614391523 podStartE2EDuration="6.398418958s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.784027435s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:58:13.39677548 +0000 UTC m=+1937.520875965" watchObservedRunningTime="2026-07-28 01:58:13.398418958 +0000 UTC m=+1937.522519439"
Jul 28 01:58:14.378793 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:14.378740    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:19.384021 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:19.383991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:58:19.384497 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:19.384464    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:29.384876 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:29.384838    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:39.385493 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:39.385444    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:49.384557 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:49.384465    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:58:59.384809 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:58:59.384764    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:59:09.385205 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:09.385161    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:59:19.384492 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:19.384451    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:59:29.384987 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:29.384940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:59:37.917795 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:37.917760    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:59:37.918293 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:37.918124    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" containerID="cri-o://2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91" gracePeriod=30
Jul 28 01:59:37.918293 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:37.918203    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kube-rbac-proxy" containerID="cri-o://80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1" gracePeriod=30
Jul 28 01:59:38.776102 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:38.776072    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerID="80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1" exitCode=2
Jul 28 01:59:38.776268 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:38.776144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerDied","Data":"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"}
Jul 28 01:59:39.379897 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:39.379858    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 28 01:59:39.385278 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:39.385251    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 28 01:59:42.757523 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.757497    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:59:42.796131 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.796103    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerID="2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91" exitCode=0
Jul 28 01:59:42.796284 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.796159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerDied","Data":"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"}
Jul 28 01:59:42.796284 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.796165    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"
Jul 28 01:59:42.796284 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.796210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc" event={"ID":"aba9d181-8472-44a1-bd7d-838a75b0611f","Type":"ContainerDied","Data":"2e596c1ceb2f884e69a66bd1d44008d3d34cfb2c232174dfc2483c314d3fca8c"}
Jul 28 01:59:42.796284 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.796245    2579 scope.go:117] "RemoveContainer" containerID="80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"
Jul 28 01:59:42.804827 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.804798    2579 scope.go:117] "RemoveContainer" containerID="2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"
Jul 28 01:59:42.812672 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.812653    2579 scope.go:117] "RemoveContainer" containerID="b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"
Jul 28 01:59:42.820121 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820094    2579 scope.go:117] "RemoveContainer" containerID="80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"
Jul 28 01:59:42.820402 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:59:42.820382    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1\": container with ID starting with 80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1 not found: ID does not exist" containerID="80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"
Jul 28 01:59:42.820465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820416    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1"} err="failed to get container status \"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1\": rpc error: code = NotFound desc = could not find container \"80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1\": container with ID starting with 80407b0e42c2b663f64afa96e6f1c000805f163dde3e8fafe6384d3b1c6dbcd1 not found: ID does not exist"
Jul 28 01:59:42.820465 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820434    2579 scope.go:117] "RemoveContainer" containerID="2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"
Jul 28 01:59:42.820686 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:59:42.820667    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91\": container with ID starting with 2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91 not found: ID does not exist" containerID="2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"
Jul 28 01:59:42.820729 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820692    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91"} err="failed to get container status \"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91\": rpc error: code = NotFound desc = could not find container \"2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91\": container with ID starting with 2e07bbe3433aeab76b42e6944c735a9fe0676015f085239c408271b779f4fe91 not found: ID does not exist"
Jul 28 01:59:42.820729 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820708    2579 scope.go:117] "RemoveContainer" containerID="b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"
Jul 28 01:59:42.820942 ip-10-0-138-153 kubenswrapper[2579]: E0728 01:59:42.820926    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd\": container with ID starting with b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd not found: ID does not exist" containerID="b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"
Jul 28 01:59:42.820999 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.820947    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd"} err="failed to get container status \"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd\": rpc error: code = NotFound desc = could not find container \"b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd\": container with ID starting with b8fd2db228be10b208b9b02a7b92f731132cab40b731fc8023f85a152b6a5fdd not found: ID does not exist"
Jul 28 01:59:42.927988 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.927893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert\") pod \"aba9d181-8472-44a1-bd7d-838a75b0611f\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") "
Jul 28 01:59:42.927988 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.927934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location\") pod \"aba9d181-8472-44a1-bd7d-838a75b0611f\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") "
Jul 28 01:59:42.927988 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.927961    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls\") pod \"aba9d181-8472-44a1-bd7d-838a75b0611f\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") "
Jul 28 01:59:42.928258 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928104    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh947\" (UniqueName: \"kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947\") pod \"aba9d181-8472-44a1-bd7d-838a75b0611f\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") "
Jul 28 01:59:42.928258 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928177    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config\") pod \"aba9d181-8472-44a1-bd7d-838a75b0611f\" (UID: \"aba9d181-8472-44a1-bd7d-838a75b0611f\") "
Jul 28 01:59:42.928357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928283    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "aba9d181-8472-44a1-bd7d-838a75b0611f" (UID: "aba9d181-8472-44a1-bd7d-838a75b0611f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:42.928357 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "aba9d181-8472-44a1-bd7d-838a75b0611f" (UID: "aba9d181-8472-44a1-bd7d-838a75b0611f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:59:42.928599 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928578    2579 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-cabundle-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:59:42.928599 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928586    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "aba9d181-8472-44a1-bd7d-838a75b0611f" (UID: "aba9d181-8472-44a1-bd7d-838a75b0611f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:59:42.928599 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.928603    2579 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aba9d181-8472-44a1-bd7d-838a75b0611f-kserve-provision-location\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:59:42.930213 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.930191    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "aba9d181-8472-44a1-bd7d-838a75b0611f" (UID: "aba9d181-8472-44a1-bd7d-838a75b0611f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:59:42.930311 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:42.930276    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947" (OuterVolumeSpecName: "kube-api-access-wh947") pod "aba9d181-8472-44a1-bd7d-838a75b0611f" (UID: "aba9d181-8472-44a1-bd7d-838a75b0611f"). InnerVolumeSpecName "kube-api-access-wh947". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:59:43.029210 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:43.029175    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aba9d181-8472-44a1-bd7d-838a75b0611f-proxy-tls\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:59:43.029210 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:43.029205    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh947\" (UniqueName: \"kubernetes.io/projected/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-api-access-wh947\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:59:43.029415 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:43.029222    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aba9d181-8472-44a1-bd7d-838a75b0611f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 01:59:43.116900 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:43.116866    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:59:43.119059 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:43.119030    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-v94sc"]
Jul 28 01:59:44.400007 ip-10-0-138-153 kubenswrapper[2579]: I0728 01:59:44.399953    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" path="/var/lib/kubelet/pods/aba9d181-8472-44a1-bd7d-838a75b0611f/volumes"
Jul 28 02:33:26.517342 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517309    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517686    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517699    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517719    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kube-rbac-proxy"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517728    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kube-rbac-proxy"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517749    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="storage-initializer"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="storage-initializer"
Jul 28 02:33:26.517817 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517813    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kserve-container"
Jul 28 02:33:26.518055 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.517821    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba9d181-8472-44a1-bd7d-838a75b0611f" containerName="kube-rbac-proxy"
Jul 28 02:33:26.521155 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.521138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.524581 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.524551    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-runtime-predictor-serving-cert\""
Jul 28 02:33:26.524723 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.524580    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 02:33:26.524923 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.524908    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-runtime-kube-rbac-proxy-sar-config\""
Jul 28 02:33:26.525181 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.525168    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 02:33:26.525266 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.525246    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 02:33:26.525481 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.525465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-96ksg\""
Jul 28 02:33:26.525548 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.525495    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 02:33:26.531758 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.531733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:33:26.636441 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.636404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.636441 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.636456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkr7\" (UniqueName: \"kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.636672 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.636518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.636672 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.636603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.636672 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.636655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737174 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737331 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737331 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737331 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737331 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkr7\" (UniqueName: \"kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.737727 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.737702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.738044 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.738020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.738101 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.738020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.739787 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.739769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.745992 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.745919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkr7\" (UniqueName: \"kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7\") pod \"isvc-sklearn-runtime-predictor-599b58cf6-wd8ll\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") " pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.833217 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.833109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:26.972792 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:26.972766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:33:26.975262 ip-10-0-138-153 kubenswrapper[2579]: W0728 02:33:26.975227    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf0bf0e_b416_4d81_9c48_00e980ff2d70.slice/crio-9a803a9dd864aa143a8448118a6c890335e7debe1df6f4cb9755dde73584bb5e WatchSource:0}: Error finding container 9a803a9dd864aa143a8448118a6c890335e7debe1df6f4cb9755dde73584bb5e: Status 404 returned error can't find the container with id 9a803a9dd864aa143a8448118a6c890335e7debe1df6f4cb9755dde73584bb5e
Jul 28 02:33:27.913882 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:27.913846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerStarted","Data":"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"}
Jul 28 02:33:27.914299 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:27.913931    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerStarted","Data":"9a803a9dd864aa143a8448118a6c890335e7debe1df6f4cb9755dde73584bb5e"}
Jul 28 02:33:32.940033 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:32.939925    2579 generic.go:356] "Generic (PLEG): container finished" podID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerID="f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763" exitCode=0
Jul 28 02:33:32.940033 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:32.940009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerDied","Data":"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"}
Jul 28 02:33:33.947464 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:33.947425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerStarted","Data":"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"}
Jul 28 02:33:33.947863 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:33.947515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerStarted","Data":"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"}
Jul 28 02:33:33.947863 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:33.947746    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:33.968070 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:33.968013    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podStartSLOduration=2.3849595519999998 podStartE2EDuration="7.967998868s" totalImagesPullingTime="0s" totalInitContainerRuntime="5.583039316s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:33:33.966474107 +0000 UTC m=+4058.090574590" watchObservedRunningTime="2026-07-28 02:33:33.967998868 +0000 UTC m=+4058.092099350"
Jul 28 02:33:34.952166 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:34.952128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:34.953328 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:34.953303    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 28 02:33:35.957474 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:35.957435    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 28 02:33:40.962665 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:40.962635    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:40.963197 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:40.963169    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 28 02:33:50.964481 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:50.964448    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:58.337315 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:58.337283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-sklearn-runtime-predictor-599b58cf6-wd8ll_adf0bf0e-b416-4d81-9c48-00e980ff2d70/kserve-container/0.log"
Jul 28 02:33:58.527818 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:58.527784    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:33:58.528069 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:58.528035    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container" containerID="cri-o://4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f" gracePeriod=30
Jul 28 02:33:58.528231 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:58.528093    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kube-rbac-proxy" containerID="cri-o://9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8" gracePeriod=30
Jul 28 02:33:59.076144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.076104    2579 generic.go:356] "Generic (PLEG): container finished" podID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerID="9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8" exitCode=2
Jul 28 02:33:59.076321 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.076175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerDied","Data":"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"}
Jul 28 02:33:59.570317 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.570293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:33:59.741893 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.741863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config\") pod \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") "
Jul 28 02:33:59.742126 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.741933    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location\") pod \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") "
Jul 28 02:33:59.742126 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.741954    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert\") pod \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") "
Jul 28 02:33:59.742126 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.742022    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrkr7\" (UniqueName: \"kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7\") pod \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") "
Jul 28 02:33:59.742126 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.742064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls\") pod \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\" (UID: \"adf0bf0e-b416-4d81-9c48-00e980ff2d70\") "
Jul 28 02:33:59.742368 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.742343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "adf0bf0e-b416-4d81-9c48-00e980ff2d70" (UID: "adf0bf0e-b416-4d81-9c48-00e980ff2d70"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:33:59.742423 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.742375    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "adf0bf0e-b416-4d81-9c48-00e980ff2d70" (UID: "adf0bf0e-b416-4d81-9c48-00e980ff2d70"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:33:59.744326 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.744285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "adf0bf0e-b416-4d81-9c48-00e980ff2d70" (UID: "adf0bf0e-b416-4d81-9c48-00e980ff2d70"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 02:33:59.744437 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.744330    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7" (OuterVolumeSpecName: "kube-api-access-qrkr7") pod "adf0bf0e-b416-4d81-9c48-00e980ff2d70" (UID: "adf0bf0e-b416-4d81-9c48-00e980ff2d70"). InnerVolumeSpecName "kube-api-access-qrkr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:33:59.765743 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.765715    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "adf0bf0e-b416-4d81-9c48-00e980ff2d70" (UID: "adf0bf0e-b416-4d81-9c48-00e980ff2d70"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:33:59.843151 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.843120    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adf0bf0e-b416-4d81-9c48-00e980ff2d70-proxy-tls\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:33:59.843151 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.843147    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:33:59.843151 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.843157    2579 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kserve-provision-location\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:33:59.843361 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.843165    2579 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/adf0bf0e-b416-4d81-9c48-00e980ff2d70-cabundle-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:33:59.843361 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:33:59.843176    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrkr7\" (UniqueName: \"kubernetes.io/projected/adf0bf0e-b416-4d81-9c48-00e980ff2d70-kube-api-access-qrkr7\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:34:00.083520 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.083429    2579 generic.go:356] "Generic (PLEG): container finished" podID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerID="4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f" exitCode=0
Jul 28 02:34:00.083520 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.083491    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"
Jul 28 02:34:00.083520 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.083496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerDied","Data":"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"}
Jul 28 02:34:00.083731 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.083559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll" event={"ID":"adf0bf0e-b416-4d81-9c48-00e980ff2d70","Type":"ContainerDied","Data":"9a803a9dd864aa143a8448118a6c890335e7debe1df6f4cb9755dde73584bb5e"}
Jul 28 02:34:00.083731 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.083599    2579 scope.go:117] "RemoveContainer" containerID="9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"
Jul 28 02:34:00.098009 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.097981    2579 scope.go:117] "RemoveContainer" containerID="4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"
Jul 28 02:34:00.105935 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.105914    2579 scope.go:117] "RemoveContainer" containerID="f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"
Jul 28 02:34:00.110595 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.110569    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:34:00.114833 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.114744    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-runtime-predictor-599b58cf6-wd8ll"]
Jul 28 02:34:00.114890 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.114868    2579 scope.go:117] "RemoveContainer" containerID="9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"
Jul 28 02:34:00.115206 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:34:00.115187    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8\": container with ID starting with 9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8 not found: ID does not exist" containerID="9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"
Jul 28 02:34:00.115272 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.115214    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8"} err="failed to get container status \"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8\": rpc error: code = NotFound desc = could not find container \"9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8\": container with ID starting with 9918eb395f2206a3cb43c2dd40637b1e61ee4690cd38f7ff1ef9c2d74f9d25b8 not found: ID does not exist"
Jul 28 02:34:00.115272 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.115232    2579 scope.go:117] "RemoveContainer" containerID="4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"
Jul 28 02:34:00.115478 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:34:00.115461    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f\": container with ID starting with 4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f not found: ID does not exist" containerID="4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"
Jul 28 02:34:00.115526 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.115483    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f"} err="failed to get container status \"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f\": rpc error: code = NotFound desc = could not find container \"4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f\": container with ID starting with 4de894a64f282b206b80e4ab2db4f789a4b6eee5b25d344594615f0ad802307f not found: ID does not exist"
Jul 28 02:34:00.115526 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.115500    2579 scope.go:117] "RemoveContainer" containerID="f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"
Jul 28 02:34:00.115712 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:34:00.115696    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763\": container with ID starting with f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763 not found: ID does not exist" containerID="f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"
Jul 28 02:34:00.115755 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.115718    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763"} err="failed to get container status \"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763\": rpc error: code = NotFound desc = could not find container \"f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763\": container with ID starting with f30e6d5b33376ec627b029a2b796dc5c541dd83b25aca56ecde53e5675139763 not found: ID does not exist"
Jul 28 02:34:00.398597 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:34:00.398523    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" path="/var/lib/kubelet/pods/adf0bf0e-b416-4d81-9c48-00e980ff2d70/volumes"
Jul 28 02:39:52.376308 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376268    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376665    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="storage-initializer"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376678    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="storage-initializer"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376694    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376710    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kube-rbac-proxy"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376720    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kube-rbac-proxy"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376776    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kserve-container"
Jul 28 02:39:52.376793 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.376789    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf0bf0e-b416-4d81-9c48-00e980ff2d70" containerName="kube-rbac-proxy"
Jul 28 02:39:52.379703 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.379687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.382193 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382171    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-96ksg\""
Jul 28 02:39:52.382193 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382186    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 02:39:52.382377 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382215    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 02:39:52.382377 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382171    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-kube-rbac-proxy-sar-config\""
Jul 28 02:39:52.382377 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382186    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 02:39:52.382959 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.382945    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 02:39:52.383035 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.383019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-triton-predictor-serving-cert\""
Jul 28 02:39:52.390278 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.390248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:39:52.444570 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.444534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.444762 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.444611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.444762 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.444643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkrvq\" (UniqueName: \"kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.444762 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.444691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.444762 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.444721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546152 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546335 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkrvq\" (UniqueName: \"kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546335 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546335 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546335 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.546739 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.547056 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.546991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.547056 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.547034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.548758 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.548738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.555056 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.555030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkrvq\" (UniqueName: \"kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq\") pod \"isvc-triton-predictor-5d7db58676-h69lx\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") " pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.690189 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.690104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:39:52.821451 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:52.821426    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:39:52.823600 ip-10-0-138-153 kubenswrapper[2579]: W0728 02:39:52.823572    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04bf124_5088_4f53_92ee_03985ba32551.slice/crio-b078d251e7783ac75d12d10b5a80b8e023c17c8fb5e840f123046b803bf08b78 WatchSource:0}: Error finding container b078d251e7783ac75d12d10b5a80b8e023c17c8fb5e840f123046b803bf08b78: Status 404 returned error can't find the container with id b078d251e7783ac75d12d10b5a80b8e023c17c8fb5e840f123046b803bf08b78
Jul 28 02:39:53.688204 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:53.688170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerStarted","Data":"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"}
Jul 28 02:39:53.688617 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:53.688235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerStarted","Data":"b078d251e7783ac75d12d10b5a80b8e023c17c8fb5e840f123046b803bf08b78"}
Jul 28 02:39:56.703408 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:56.703373    2579 generic.go:356] "Generic (PLEG): container finished" podID="b04bf124-5088-4f53-92ee-03985ba32551" containerID="068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12" exitCode=0
Jul 28 02:39:56.703763 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:56.703447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerDied","Data":"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"}
Jul 28 02:39:56.704625 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:39:56.704610    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:41:50.374068 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:50.374033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerStarted","Data":"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"}
Jul 28 02:41:51.381243 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:51.381205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerStarted","Data":"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"}
Jul 28 02:41:51.381733 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:51.381348    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:41:51.412681 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:51.412630    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" podStartSLOduration=2.269484877 podStartE2EDuration="1m59.412612752s" totalImagesPullingTime="1m53.547627018s" totalInitContainerRuntime="3.595500857s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:41:51.409205988 +0000 UTC m=+4555.533306490" watchObservedRunningTime="2026-07-28 02:41:51.412612752 +0000 UTC m=+4555.536713234"
Jul 28 02:41:52.386023 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:52.385985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:41:52.387243 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:52.387216    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 28 02:41:53.390227 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:53.390185    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 28 02:41:58.399011 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:58.398962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:41:58.399806 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:41:58.399789    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:42:04.770900 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:04.770865    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:42:04.771408 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:04.771125    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container" containerID="cri-o://1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b" gracePeriod=30
Jul 28 02:42:04.771408 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:04.771172    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kube-rbac-proxy" containerID="cri-o://b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a" gracePeriod=30
Jul 28 02:42:05.455604 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:05.455568    2579 generic.go:356] "Generic (PLEG): container finished" podID="b04bf124-5088-4f53-92ee-03985ba32551" containerID="b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a" exitCode=2
Jul 28 02:42:05.455766 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:05.455641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerDied","Data":"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"}
Jul 28 02:42:07.011933 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.011909    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:42:07.170962 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.170881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkrvq\" (UniqueName: \"kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq\") pod \"b04bf124-5088-4f53-92ee-03985ba32551\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") "
Jul 28 02:42:07.170962 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.170926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config\") pod \"b04bf124-5088-4f53-92ee-03985ba32551\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") "
Jul 28 02:42:07.170962 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.170956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert\") pod \"b04bf124-5088-4f53-92ee-03985ba32551\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") "
Jul 28 02:42:07.171258 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.171033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls\") pod \"b04bf124-5088-4f53-92ee-03985ba32551\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") "
Jul 28 02:42:07.171258 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.171104    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location\") pod \"b04bf124-5088-4f53-92ee-03985ba32551\" (UID: \"b04bf124-5088-4f53-92ee-03985ba32551\") "
Jul 28 02:42:07.171395 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.171366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b04bf124-5088-4f53-92ee-03985ba32551" (UID: "b04bf124-5088-4f53-92ee-03985ba32551"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:42:07.171527 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.171402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b04bf124-5088-4f53-92ee-03985ba32551" (UID: "b04bf124-5088-4f53-92ee-03985ba32551"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:42:07.171527 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.171512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b04bf124-5088-4f53-92ee-03985ba32551" (UID: "b04bf124-5088-4f53-92ee-03985ba32551"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:42:07.173251 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.173229    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq" (OuterVolumeSpecName: "kube-api-access-bkrvq") pod "b04bf124-5088-4f53-92ee-03985ba32551" (UID: "b04bf124-5088-4f53-92ee-03985ba32551"). InnerVolumeSpecName "kube-api-access-bkrvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:42:07.173335 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.173257    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b04bf124-5088-4f53-92ee-03985ba32551" (UID: "b04bf124-5088-4f53-92ee-03985ba32551"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 02:42:07.272472 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.272437    2579 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b04bf124-5088-4f53-92ee-03985ba32551-kserve-provision-location\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:42:07.272472 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.272465    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkrvq\" (UniqueName: \"kubernetes.io/projected/b04bf124-5088-4f53-92ee-03985ba32551-kube-api-access-bkrvq\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:42:07.272472 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.272476    2579 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:42:07.272698 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.272486    2579 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b04bf124-5088-4f53-92ee-03985ba32551-cabundle-cert\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:42:07.272698 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.272495    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b04bf124-5088-4f53-92ee-03985ba32551-proxy-tls\") on node \"ip-10-0-138-153.ec2.internal\" DevicePath \"\""
Jul 28 02:42:07.466462 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.466377    2579 generic.go:356] "Generic (PLEG): container finished" podID="b04bf124-5088-4f53-92ee-03985ba32551" containerID="1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b" exitCode=0
Jul 28 02:42:07.466462 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.466431    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"
Jul 28 02:42:07.466462 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.466452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerDied","Data":"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"}
Jul 28 02:42:07.466680 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.466506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx" event={"ID":"b04bf124-5088-4f53-92ee-03985ba32551","Type":"ContainerDied","Data":"b078d251e7783ac75d12d10b5a80b8e023c17c8fb5e840f123046b803bf08b78"}
Jul 28 02:42:07.466680 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.466533    2579 scope.go:117] "RemoveContainer" containerID="b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"
Jul 28 02:42:07.476605 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.476582    2579 scope.go:117] "RemoveContainer" containerID="1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"
Jul 28 02:42:07.484023 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.483999    2579 scope.go:117] "RemoveContainer" containerID="068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"
Jul 28 02:42:07.491207 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491189    2579 scope.go:117] "RemoveContainer" containerID="b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"
Jul 28 02:42:07.491453 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:42:07.491437    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a\": container with ID starting with b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a not found: ID does not exist" containerID="b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"
Jul 28 02:42:07.491529 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491465    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a"} err="failed to get container status \"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a\": rpc error: code = NotFound desc = could not find container \"b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a\": container with ID starting with b4389c199de1bc3aa43e87a0d496ed093fc90bbcc166528c81c0647a839fcc3a not found: ID does not exist"
Jul 28 02:42:07.491529 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491487    2579 scope.go:117] "RemoveContainer" containerID="1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"
Jul 28 02:42:07.491729 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:42:07.491705    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b\": container with ID starting with 1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b not found: ID does not exist" containerID="1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"
Jul 28 02:42:07.491768 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491740    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b"} err="failed to get container status \"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b\": rpc error: code = NotFound desc = could not find container \"1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b\": container with ID starting with 1868fb1792ccffee5448780cc5b764767e12f27176459e91f0468af031c63c6b not found: ID does not exist"
Jul 28 02:42:07.491768 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491754    2579 scope.go:117] "RemoveContainer" containerID="068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"
Jul 28 02:42:07.491934 ip-10-0-138-153 kubenswrapper[2579]: E0728 02:42:07.491919    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12\": container with ID starting with 068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12 not found: ID does not exist" containerID="068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"
Jul 28 02:42:07.492006 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.491939    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12"} err="failed to get container status \"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12\": rpc error: code = NotFound desc = could not find container \"068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12\": container with ID starting with 068cc684fa295cabe007855483e8a86cd52aacd3dac90d39a515ffe52778ae12 not found: ID does not exist"
Jul 28 02:42:07.517750 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.517725    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:42:07.527558 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:07.527537    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-triton-predictor-5d7db58676-h69lx"]
Jul 28 02:42:08.398622 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:42:08.398588    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04bf124-5088-4f53-92ee-03985ba32551" path="/var/lib/kubelet/pods/b04bf124-5088-4f53-92ee-03985ba32551/volumes"
Jul 28 02:56:53.597368 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597333    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxmf9/must-gather-dlsjr"]
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597712    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="storage-initializer"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597723    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="storage-initializer"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597729    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597734    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kube-rbac-proxy"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kube-rbac-proxy"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597807    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kserve-container"
Jul 28 02:56:53.597865 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.597816    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04bf124-5088-4f53-92ee-03985ba32551" containerName="kube-rbac-proxy"
Jul 28 02:56:53.599801 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.599785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.602090 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.602067    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxmf9\"/\"kube-root-ca.crt\""
Jul 28 02:56:53.602182 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.602067    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxmf9\"/\"openshift-service-ca.crt\""
Jul 28 02:56:53.611582 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.611553    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/must-gather-dlsjr"]
Jul 28 02:56:53.670203 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.670166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr427\" (UniqueName: \"kubernetes.io/projected/0a80e6a0-08ad-46dd-ae53-a41d7342909b-kube-api-access-sr427\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.670378 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.670240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a80e6a0-08ad-46dd-ae53-a41d7342909b-must-gather-output\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.771668 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.771637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr427\" (UniqueName: \"kubernetes.io/projected/0a80e6a0-08ad-46dd-ae53-a41d7342909b-kube-api-access-sr427\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.771815 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.771699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a80e6a0-08ad-46dd-ae53-a41d7342909b-must-gather-output\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.772028 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.772009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0a80e6a0-08ad-46dd-ae53-a41d7342909b-must-gather-output\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.780275 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.780245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr427\" (UniqueName: \"kubernetes.io/projected/0a80e6a0-08ad-46dd-ae53-a41d7342909b-kube-api-access-sr427\") pod \"must-gather-dlsjr\" (UID: \"0a80e6a0-08ad-46dd-ae53-a41d7342909b\") " pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:53.925227 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:53.925129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/must-gather-dlsjr"
Jul 28 02:56:54.055243 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:54.055217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/must-gather-dlsjr"]
Jul 28 02:56:54.057359 ip-10-0-138-153 kubenswrapper[2579]: W0728 02:56:54.057331    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a80e6a0_08ad_46dd_ae53_a41d7342909b.slice/crio-609787b88fadf81eed9cd712cdbfc3fa41f83c5f8542a3f9741974c71a7690e4 WatchSource:0}: Error finding container 609787b88fadf81eed9cd712cdbfc3fa41f83c5f8542a3f9741974c71a7690e4: Status 404 returned error can't find the container with id 609787b88fadf81eed9cd712cdbfc3fa41f83c5f8542a3f9741974c71a7690e4
Jul 28 02:56:54.058871 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:54.058851    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:56:54.410839 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:54.410807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/must-gather-dlsjr" event={"ID":"0a80e6a0-08ad-46dd-ae53-a41d7342909b","Type":"ContainerStarted","Data":"609787b88fadf81eed9cd712cdbfc3fa41f83c5f8542a3f9741974c71a7690e4"}
Jul 28 02:56:55.419134 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:55.419002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/must-gather-dlsjr" event={"ID":"0a80e6a0-08ad-46dd-ae53-a41d7342909b","Type":"ContainerStarted","Data":"46774bbbb88066fcda57868eaffb7df24955e8a10b4183cc7c89ce12669866bd"}
Jul 28 02:56:55.419682 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:55.419648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/must-gather-dlsjr" event={"ID":"0a80e6a0-08ad-46dd-ae53-a41d7342909b","Type":"ContainerStarted","Data":"8bec01415192713dcc98b033dd2bd26a8ccaca714bf7682ad2d5d53b7658e88a"}
Jul 28 02:56:55.435835 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:55.435779    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxmf9/must-gather-dlsjr" podStartSLOduration=1.691325671 podStartE2EDuration="2.435762428s" totalImagesPullingTime="744.436757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:56:55.434282287 +0000 UTC m=+5459.558382769" watchObservedRunningTime="2026-07-28 02:56:55.435762428 +0000 UTC m=+5459.559862908"
Jul 28 02:56:56.297586 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:56.297540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b6s48_be464c89-fd49-42df-87c7-04f020c01aa1/global-pull-secret-syncer/0.log"
Jul 28 02:56:56.546449 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:56.546410    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t2tkm_43b5834e-ec09-4528-81ea-61434c05de0e/konnectivity-agent/0.log"
Jul 28 02:56:56.626648 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:56:56.626564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-153.ec2.internal_0d84437a22a1c0a2760cb8e46a57acd1/haproxy/0.log"
Jul 28 02:57:00.095762 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.095734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/alertmanager/0.log"
Jul 28 02:57:00.121403 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.121371    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/config-reloader/0.log"
Jul 28 02:57:00.159548 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.159515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/kube-rbac-proxy-web/0.log"
Jul 28 02:57:00.197886 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.197821    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/kube-rbac-proxy/0.log"
Jul 28 02:57:00.231457 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.231406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/kube-rbac-proxy-metric/0.log"
Jul 28 02:57:00.265705 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.265674    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/prom-label-proxy/0.log"
Jul 28 02:57:00.301951 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.301911    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_60bfe38f-dc37-475a-97c1-de123da3a69a/init-config-reloader/0.log"
Jul 28 02:57:00.426379 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.426272    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zfrsc_f7c7a897-8186-4c34-8f4e-d8790c6b2e0a/kube-state-metrics/0.log"
Jul 28 02:57:00.457494 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.457472    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zfrsc_f7c7a897-8186-4c34-8f4e-d8790c6b2e0a/kube-rbac-proxy-main/0.log"
Jul 28 02:57:00.486266 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.486238    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zfrsc_f7c7a897-8186-4c34-8f4e-d8790c6b2e0a/kube-rbac-proxy-self/0.log"
Jul 28 02:57:00.534388 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.534351    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f8d968c67-st5jn_88a08103-a650-4789-860f-5f4a12e50cf5/metrics-server/0.log"
Jul 28 02:57:00.566722 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.566685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-gdpv2_748cebb1-9ad7-4bf0-8e65-37f6def60d8f/monitoring-plugin/0.log"
Jul 28 02:57:00.603650 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.603623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8bxt_ed801cc1-f8cc-41fe-8315-af86f4202a70/node-exporter/0.log"
Jul 28 02:57:00.631407 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.631368    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8bxt_ed801cc1-f8cc-41fe-8315-af86f4202a70/kube-rbac-proxy/0.log"
Jul 28 02:57:00.662667 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.662555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8bxt_ed801cc1-f8cc-41fe-8315-af86f4202a70/init-textfile/0.log"
Jul 28 02:57:00.870841 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.870807    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ttck9_1c60de02-6554-4b09-89ac-18a47bc67b16/kube-rbac-proxy-main/0.log"
Jul 28 02:57:00.907559 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.907535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ttck9_1c60de02-6554-4b09-89ac-18a47bc67b16/kube-rbac-proxy-self/0.log"
Jul 28 02:57:00.943923 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:00.943888    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ttck9_1c60de02-6554-4b09-89ac-18a47bc67b16/openshift-state-metrics/0.log"
Jul 28 02:57:01.001748 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.001720    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/prometheus/0.log"
Jul 28 02:57:01.026092 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.026061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/config-reloader/0.log"
Jul 28 02:57:01.060441 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.060382    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/thanos-sidecar/0.log"
Jul 28 02:57:01.090729 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.090702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/kube-rbac-proxy-web/0.log"
Jul 28 02:57:01.123498 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.123418    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/kube-rbac-proxy/0.log"
Jul 28 02:57:01.154670 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.154649    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/kube-rbac-proxy-thanos/0.log"
Jul 28 02:57:01.186303 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.186267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e4cde11-4dd5-4df5-be5f-ebe878ba9c17/init-config-reloader/0.log"
Jul 28 02:57:01.226223 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.226187    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-dqln4_e6518348-bd28-4af7-af5e-011b69f04523/prometheus-operator/0.log"
Jul 28 02:57:01.251519 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.251483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-dqln4_e6518348-bd28-4af7-af5e-011b69f04523/kube-rbac-proxy/0.log"
Jul 28 02:57:01.283884 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.283839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-6tlz2_b104c575-aec9-4aec-b4cf-14495844c88a/prometheus-operator-admission-webhook/0.log"
Jul 28 02:57:01.320815 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.320774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678dfc8957-7cgkf_ad9e1ad7-70c1-4524-89ab-76498c5953dc/telemeter-client/0.log"
Jul 28 02:57:01.350674 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.350609    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678dfc8957-7cgkf_ad9e1ad7-70c1-4524-89ab-76498c5953dc/reload/0.log"
Jul 28 02:57:01.375371 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.375291    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678dfc8957-7cgkf_ad9e1ad7-70c1-4524-89ab-76498c5953dc/kube-rbac-proxy/0.log"
Jul 28 02:57:01.422476 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.422439    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/thanos-query/0.log"
Jul 28 02:57:01.454279 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.454241    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/kube-rbac-proxy-web/0.log"
Jul 28 02:57:01.478820 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.478778    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/kube-rbac-proxy/0.log"
Jul 28 02:57:01.504603 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.504575    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/prom-label-proxy/0.log"
Jul 28 02:57:01.533426 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.533359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/kube-rbac-proxy-rules/0.log"
Jul 28 02:57:01.573618 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:01.573592    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b46c44d5f-8gqhc_e22de437-58c7-4a0d-aefe-8ad70ea5eaa2/kube-rbac-proxy-metrics/0.log"
Jul 28 02:57:04.028919 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:04.028883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-x2fg5_c3652c76-ed8f-461d-8241-a9778f207c58/download-server/0.log"
Jul 28 02:57:05.193021 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.192993    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"]
Jul 28 02:57:05.203340 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.203001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.208336 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.208310    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxmf9\"/\"default-dockercfg-rxfnb\""
Jul 28 02:57:05.210879 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.210851    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"]
Jul 28 02:57:05.388923 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.388887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-sys\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.389144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.388934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-podres\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.389144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.388959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfs5\" (UniqueName: \"kubernetes.io/projected/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-kube-api-access-2pfs5\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.389144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.389106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-lib-modules\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.389144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.389137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-proc\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489673 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-lib-modules\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489673 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-proc\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-sys\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-podres\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfs5\" (UniqueName: \"kubernetes.io/projected/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-kube-api-access-2pfs5\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-lib-modules\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-proc\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-sys\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.489920 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.489885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-podres\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.490696 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.490677    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6vxb_c628472c-dbbd-47e1-a86e-f0b9a5306da6/dns/0.log"
Jul 28 02:57:05.499851 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.499822    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfs5\" (UniqueName: \"kubernetes.io/projected/8781922a-fee8-43b2-8aba-8d5c1bc90ac2-kube-api-access-2pfs5\") pod \"perf-node-gather-daemonset-x79mv\" (UID: \"8781922a-fee8-43b2-8aba-8d5c1bc90ac2\") " pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.514729 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.514708    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6vxb_c628472c-dbbd-47e1-a86e-f0b9a5306da6/kube-rbac-proxy/0.log"
Jul 28 02:57:05.516723 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.516698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:05.617990 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.617943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vg9gk_eb6ce0b0-6fe4-4bc3-92bc-773b8c5f9b89/dns-node-resolver/0.log"
Jul 28 02:57:05.667519 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:05.667492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"]
Jul 28 02:57:06.179153 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.179075    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d587bf6b4-zppmq_444364e4-db25-4d41-a654-57607913a7d7/registry/0.log"
Jul 28 02:57:06.233222 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.233176    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qfwhr_0ec88b96-00b0-4c01-9735-97c322adff03/node-ca/0.log"
Jul 28 02:57:06.488203 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.488161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv" event={"ID":"8781922a-fee8-43b2-8aba-8d5c1bc90ac2","Type":"ContainerStarted","Data":"6d38d6679f62de7337d4a8ebb93df4dd4647ffe97b6dcf2e8492ea78ba69d54f"}
Jul 28 02:57:06.488203 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.488209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv" event={"ID":"8781922a-fee8-43b2-8aba-8d5c1bc90ac2","Type":"ContainerStarted","Data":"e32fd3a2d417aaf1aebe9c493bd3d17ae8e7fc21314c2d718e5ee14d93bfe8c3"}
Jul 28 02:57:06.488481 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.488311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:06.504057 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:06.503995    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv" podStartSLOduration=1.5039575790000002 podStartE2EDuration="1.503957579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:57:06.50289673 +0000 UTC m=+5470.626997212" watchObservedRunningTime="2026-07-28 02:57:06.503957579 +0000 UTC m=+5470.628058060"
Jul 28 02:57:07.319180 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:07.319150    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pl7jv_a83c9cad-df78-4a37-9ac8-b7c87f513fe0/serve-healthcheck-canary/0.log"
Jul 28 02:57:07.891063 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:07.891032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlr62_8c8e282e-73f2-4f26-9761-ecaad95c14b6/kube-rbac-proxy/0.log"
Jul 28 02:57:07.915227 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:07.915196    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlr62_8c8e282e-73f2-4f26-9761-ecaad95c14b6/exporter/0.log"
Jul 28 02:57:07.939041 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:07.939010    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlr62_8c8e282e-73f2-4f26-9761-ecaad95c14b6/extractor/0.log"
Jul 28 02:57:10.670253 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.670226    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-n6c4j_ffc31fc5-ce42-4191-9304-d5edd31c90c3/s3-init/0.log"
Jul 28 02:57:10.689746 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.689721    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-n6c4j_ffc31fc5-ce42-4191-9304-d5edd31c90c3/download-hf-model/0.log"
Jul 28 02:57:10.722013 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.721982    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-z8lld_b661ae28-afa1-439a-9e11-81fd5ed391f2/s3-tls-init-custom/0.log"
Jul 28 02:57:10.741675 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.741655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-z8lld_b661ae28-afa1-439a-9e11-81fd5ed391f2/download-hf-model/0.log"
Jul 28 02:57:10.769790 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.769766    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-xcq48_eec2baa4-d4e6-4e9c-affd-b3bcf734657f/s3-tls-init-serving/0.log"
Jul 28 02:57:10.791230 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:10.791203    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-xcq48_eec2baa4-d4e6-4e9c-affd-b3bcf734657f/download-hf-model/0.log"
Jul 28 02:57:12.502901 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:12.502874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxmf9/perf-node-gather-daemonset-x79mv"
Jul 28 02:57:16.350440 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.350413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/kube-multus-additional-cni-plugins/0.log"
Jul 28 02:57:16.374144 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.374024    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/egress-router-binary-copy/0.log"
Jul 28 02:57:16.398699 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.398668    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/cni-plugins/0.log"
Jul 28 02:57:16.422560 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.422525    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/bond-cni-plugin/0.log"
Jul 28 02:57:16.449427 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.449404    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/routeoverride-cni/0.log"
Jul 28 02:57:16.476885 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.476862    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/whereabouts-cni-bincopy/0.log"
Jul 28 02:57:16.498650 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.498618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwjnd_cea807b4-1440-4ce0-9df4-b370eede16cc/whereabouts-cni/0.log"
Jul 28 02:57:16.816101 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.816076    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qjndz_a61aff14-3b2b-4ac8-8274-635e5535b752/kube-multus/0.log"
Jul 28 02:57:16.937639 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.937570    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vcp24_bb74f5be-8c87-4755-aab0-219dad056c51/network-metrics-daemon/0.log"
Jul 28 02:57:16.958383 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:16.958341    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vcp24_bb74f5be-8c87-4755-aab0-219dad056c51/kube-rbac-proxy/0.log"
Jul 28 02:57:18.177221 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.177192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/ovn-controller/0.log"
Jul 28 02:57:18.199233 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.199199    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/ovn-acl-logging/0.log"
Jul 28 02:57:18.223515 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.223486    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/kube-rbac-proxy-node/0.log"
Jul 28 02:57:18.252175 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.252145    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 02:57:18.275796 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.275767    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/northd/0.log"
Jul 28 02:57:18.299405 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.299376    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/nbdb/0.log"
Jul 28 02:57:18.322011 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.321984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/sbdb/0.log"
Jul 28 02:57:18.372492 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:18.372462    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zxgq6_3b0d5cc7-1817-41c9-b23f-affeb6cc48a7/ovnkube-controller/0.log"
Jul 28 02:57:19.365757 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:19.365725    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-97l5d_415654d7-ed86-4eb1-8d2e-3cf3aef8bb8f/network-check-target-container/0.log"
Jul 28 02:57:20.346243 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:20.346211    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4lj4f_614cafc4-6fe0-402d-9677-9f9e9c1c42c7/iptables-alerter/0.log"
Jul 28 02:57:21.073076 ip-10-0-138-153 kubenswrapper[2579]: I0728 02:57:21.073047    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qm2v8_45d68a4a-4adb-4fa6-99d7-67de6c4b6bed/tuned/0.log"